Nov 14 20:30:50 user nova-compute[76442]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=76442) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=76442) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=76442) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 20:30:50 user nova-compute[76442]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:30:50 user nova-compute[76442]: INFO nova.virt.driver [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 20:30:50 user nova-compute[76442]: INFO nova.compute.provider_config [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] Acquiring lock "singleton_lock" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] Acquired lock "singleton_lock" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] Releasing lock "singleton_lock" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] Full set of CONF: {{(pid=76442) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ******************************************************************************** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] Configuration options gathered from: {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ================================================================================ {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] allow_resize_to_same_host      = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] arq_binding_timeout            = 300 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] backdoor_port                  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] backdoor_socket                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] block_device_allocate_retries  = 300 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] block_device_allocate_retries_interval = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cert                           = self.pem {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute_monitors               = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] config_dir                     = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] config_drive_format            = iso9660 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] config_source                  = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] console_host                   = user {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] control_exchange               = nova {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cpu_allocation_ratio           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] daemon                         = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] debug                          = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] default_access_ip_network_name = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] default_availability_zone      = nova {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] default_ephemeral_format       = ext4 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] default_green_pool_size        = 1000 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] default_schedule_zone          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] disk_allocation_ratio          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] enable_new_services            = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] enabled_apis                   = ['osapi_compute'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] enabled_ssl_apis               = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] flat_injected                  = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] force_config_drive             = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] force_raw_images               = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] graceful_shutdown_timeout      = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] heal_instance_info_cache_interval = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] host                           = user {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] instance_build_timeout         = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] instance_delete_interval       = 300 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] instance_format                = [instance: %(uuid)s]  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] instance_name_template         = instance-%08x {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] instance_usage_audit           = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] instance_usage_audit_period    = month {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] internal_service_availability_zone = internal {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] key                            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] live_migration_retry_count     = 30 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] log_config_append              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] log_dir                        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] log_file                       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] log_options                    = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] log_rotate_interval            = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] log_rotate_interval_type       = days {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] log_rotation_type              = none {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] long_rpc_timeout               = 1800 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] max_concurrent_builds          = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] max_concurrent_live_migrations = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] max_concurrent_snapshots       = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] max_local_block_devices        = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] max_logfile_count              = 30 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] max_logfile_size_mb            = 200 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] maximum_instance_delete_attempts = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] metadata_listen                = 0.0.0.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] metadata_listen_port           = 8775 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] metadata_workers               = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] migrate_max_retries            = -1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] mkisofs_cmd                    = genisoimage {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] my_ip                          = 10.0.0.210 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] network_allocate_retries       = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] osapi_compute_listen_port      = 8774 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] osapi_compute_unique_server_name_scope =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] osapi_compute_workers          = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] password_length                = 12 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] periodic_enable                = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] periodic_fuzzy_delay           = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] pointer_model                  = ps2mouse {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] preallocate_images             = none {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] publish_errors                 = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] pybasedir                      = /opt/stack/nova {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ram_allocation_ratio           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] rate_limit_burst               = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] rate_limit_except_level        = CRITICAL {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] rate_limit_interval            = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] reboot_timeout                 = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] reclaim_instance_interval      = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] record                         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] reimage_timeout_per_gb         = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] report_interval                = 120 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] rescue_timeout                 = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] reserved_host_cpus             = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] reserved_host_disk_mb          = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] reserved_host_memory_mb        = 512 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] reserved_huge_pages            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] resize_confirm_window          = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] resize_fs_using_block_device   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] resume_guests_state_on_host_boot = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] rpc_response_timeout           = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] run_external_periodic_tasks    = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] running_deleted_instance_action = reap {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] running_deleted_instance_poll_interval = 1800 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] running_deleted_instance_timeout = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler_instance_sync_interval = 120 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_down_time              = 720 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] servicegroup_driver            = db {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] shelved_offload_time           = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] shelved_poll_interval          = 3600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] shutdown_timeout               = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] source_is_ipv6                 = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ssl_only                       = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] state_path                     = /opt/stack/data/nova {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] sync_power_state_interval      = 600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] sync_power_state_pool_size     = 1000 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] syslog_log_facility            = LOG_USER {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] tempdir                        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] timeout_nbd                    = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] transport_url                  = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] update_resources_interval      = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] use_cow_images                 = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] use_eventlog                   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] use_journal                    = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] use_json                       = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] use_rootwrap_daemon            = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] use_stderr                     = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] use_syslog                     = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vcpu_pin_set                   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plugging_is_fatal          = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plugging_timeout           = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] virt_mkfs                      = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] volume_usage_poll_interval     = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] watch_log_file                 = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] web                            = /usr/share/spice-html5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_concurrency.disable_process_locking = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.auth_strategy              = keystone {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.compute_link_prefix        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.dhcp_domain                = novalocal {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.enable_instance_password   = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.glance_link_prefix         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.instance_list_per_project_cells = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.list_records_by_skipping_down_cells = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.local_metadata_per_cell    = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.max_limit                  = 1000 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.metadata_cache_expiration  = 15 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.neutron_default_tenant_id  = default {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.use_forwarded_for          = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.use_neutron_default_nets   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.vendordata_dynamic_targets = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.vendordata_jsonfile_path   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.backend                  = dogpile.cache.memcached {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.backend_argument         = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.config_prefix            = cache.oslo {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.dead_timeout             = 60.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.debug_cache_backend      = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.enable_retry_client      = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.enable_socket_keepalive  = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.enabled                  = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.expiration_time          = 600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.hashclient_retry_attempts = 2 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_dead_retry      = 300 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_password        =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_pool_maxsize    = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_sasl_enabled    = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.memcache_username        =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.proxies                  = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.retry_attempts           = 2 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.retry_delay              = 0.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.socket_keepalive_count   = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.socket_keepalive_idle    = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.socket_keepalive_interval = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.tls_allowed_ciphers      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.tls_cafile               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.tls_certfile             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.tls_enabled              = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cache.tls_keyfile              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.auth_section            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.auth_type               = password {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.cafile                  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.certfile                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.collect_timing          = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.cross_az_attach         = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.debug                   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.endpoint_template       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.http_retries            = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.insecure                = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.keyfile                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.os_region_name          = RegionOne {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.split_loggers           = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cinder.timeout                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.cpu_dedicated_set      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.cpu_shared_set         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.image_type_exclude_list = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.max_concurrent_disk_ops = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.max_disk_devices_to_attach = -1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.resource_provider_association_refresh = 300 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.shutdown_retry_interval = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] conductor.workers              = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] console.allowed_origins        = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] console.ssl_ciphers            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] console.ssl_minimum_version    = default {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] consoleauth.token_ttl          = 600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.cafile                  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.certfile                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.collect_timing          = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.connect_retries         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.connect_retry_delay     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.endpoint_override       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.insecure                = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.keyfile                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.max_version             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.min_version             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.region_name             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.service_name            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.service_type            = accelerator {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.split_loggers           = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.status_code_retries     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.status_code_retry_delay = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.timeout                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] cyborg.version                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.backend               = sqlalchemy {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.connection            = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.connection_debug      = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.connection_parameters =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.connection_recycle_time = 3600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.connection_trace      = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.db_inc_retry_interval = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.db_max_retries        = 20 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.db_max_retry_interval = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.db_retry_interval     = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.max_overflow          = 50 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.max_pool_size         = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.max_retries           = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.mysql_wsrep_sync_wait = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.pool_timeout          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.retry_interval        = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.slave_connection      = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] database.sqlite_synchronous    = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.backend           = sqlalchemy {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.connection        = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.connection_debug  = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.connection_parameters =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.connection_recycle_time = 3600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.connection_trace  = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.db_inc_retry_interval = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.db_max_retries    = 20 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.db_max_retry_interval = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.db_retry_interval = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.max_overflow      = 50 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.max_pool_size     = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.max_retries       = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.pool_timeout      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.retry_interval    = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.slave_connection  = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] api_database.sqlite_synchronous = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] devices.enabled_mdev_types     = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ephemeral_storage_encryption.enabled = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.api_servers             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.cafile                  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.certfile                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.collect_timing          = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.connect_retries         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.connect_retry_delay     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.debug                   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.default_trusted_certificate_ids = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.enable_certificate_validation = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.enable_rbd_download     = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.endpoint_override       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.insecure                = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.keyfile                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.max_version             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.min_version             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.num_retries             = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.rbd_ceph_conf           =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.rbd_connect_timeout     = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.rbd_pool                =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.rbd_user                =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.region_name             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.service_name            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.service_type            = image {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.split_loggers           = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.status_code_retries     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.status_code_retry_delay = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.timeout                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.verify_glance_signatures = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] glance.version                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] guestfs.debug                  = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.config_drive_cdrom      = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.config_drive_inject_password = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.enable_instance_metrics_collection = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.enable_remotefx         = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.instances_path_share    =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.iscsi_initiator_list    = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.limit_cpu_features      = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.power_state_check_timeframe = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.use_multipath_io        = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.volume_attach_retry_count = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.vswitch_name            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] mks.enabled                    = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] image_cache.manager_interval   = 2400 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] image_cache.precache_concurrency = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] image_cache.remove_unused_base_images = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] image_cache.subdirectory_name  = _base {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.api_max_retries         = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.api_retry_interval      = 2 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.auth_section            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.auth_type               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.cafile                  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.certfile                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.collect_timing          = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.conductor_group         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.connect_retries         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.connect_retry_delay     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.endpoint_override       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.insecure                = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.keyfile                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.max_version             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.min_version             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.peer_list               = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.region_name             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.serial_console_state_timeout = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.service_name            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.service_type            = baremetal {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.split_loggers           = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.status_code_retries     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.status_code_retry_delay = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.timeout                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ironic.version                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] key_manager.fixed_key          = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.barbican_api_version  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.barbican_endpoint     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.barbican_endpoint_type = public {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.barbican_region_name  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.cafile                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.certfile              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.collect_timing        = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.insecure              = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.keyfile               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.number_of_retries     = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.retry_delay           = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.send_service_user_token = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.split_loggers         = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.timeout               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.verify_ssl            = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican.verify_ssl_path       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican_service_user.auth_section = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican_service_user.auth_type = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican_service_user.cafile   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican_service_user.certfile = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican_service_user.collect_timing = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican_service_user.insecure = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican_service_user.keyfile  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican_service_user.split_loggers = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] barbican_service_user.timeout  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.approle_role_id          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.approle_secret_id        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.cafile                   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.certfile                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.collect_timing           = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.insecure                 = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.keyfile                  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.kv_mountpoint            = secret {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.kv_path                  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.kv_version               = 2 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.namespace                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.root_token_id            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.split_loggers            = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.ssl_ca_crt_file          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.timeout                  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.use_ssl                  = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.auth_section          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.auth_type             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.cafile                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.certfile              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.collect_timing        = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.connect_retries       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.connect_retry_delay   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.endpoint_override     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.insecure              = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.keyfile               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.max_version           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.min_version           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.region_name           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.service_name          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.service_type          = identity {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.split_loggers         = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.status_code_retries   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.status_code_retry_delay = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.timeout               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] keystone.version               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.connection_uri         =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.cpu_mode               = custom {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: WARNING oslo_config.cfg [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.cpu_power_governor_high = performance {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.cpu_power_governor_low = powersave {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.cpu_power_management   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.device_detach_attempts = 8 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.device_detach_timeout  = 20 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.disk_cachemodes        = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.disk_prefix            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.enabled_perf_events    = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.file_backed_memory     = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.gid_maps               = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.hw_disk_discard        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.hw_machine_type        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.images_rbd_glance_store_name =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.images_rbd_pool        = rbd {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.images_type            = default {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.images_volume_group    = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.inject_key             = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.inject_partition       = -2 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.inject_password        = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.iscsi_iface            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.iser_use_multipath     = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_bandwidth = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_downtime = 500 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_inbound_addr = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_permit_post_copy = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_scheme  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_timeout_action = abort {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_tunnelled = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: WARNING oslo_config.cfg [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 20:30:50 user nova-compute[76442]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 20:30:50 user nova-compute[76442]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 20:30:50 user nova-compute[76442]: and ``live_migration_inbound_addr`` respectively.
Nov 14 20:30:50 user nova-compute[76442]: ).  Its value may be silently ignored in the future.
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.live_migration_with_native_tls = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.max_queues             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.nfs_mount_options      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.num_memory_encrypted_guests = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.num_pcie_ports         = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.pmem_namespaces        = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.quobyte_client_cfg     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rbd_secret_uuid        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rbd_user               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.remote_filesystem_transport = ssh {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rescue_image_id        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rescue_kernel_id       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rescue_ramdisk_id      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.rx_queue_size          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.smbfs_mount_options    =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.snapshot_compression   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.snapshot_image_format  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.sparse_logical_volumes = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.swtpm_enabled          = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.swtpm_group            = tss {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.swtpm_user             = tss {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.sysinfo_serial         = unique {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.tb_cache_size          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.tx_queue_size          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.uid_maps               = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.use_virtio_for_bridges = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.virt_type              = kvm {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.volume_clear           = zero {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.volume_clear_size      = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.volume_use_multipath   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.vzstorage_cache_path   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.vzstorage_mount_user   = stack {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.auth_section           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.auth_type              = password {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.cafile                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.certfile               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.collect_timing         = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.connect_retries        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.connect_retry_delay    = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.default_floating_pool  = public {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.endpoint_override      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.extension_sync_interval = 600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.http_retries           = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.insecure               = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.keyfile                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.max_version            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.min_version            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.ovs_bridge             = br-int {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.physnets               = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.region_name            = RegionOne {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.service_metadata_proxy = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.service_name           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.service_type           = network {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.split_loggers          = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.status_code_retries    = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.status_code_retry_delay = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.timeout                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] neutron.version                = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] notifications.bdms_in_notifications = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] notifications.default_level    = INFO {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] notifications.notification_format = unversioned {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] notifications.notify_on_state_change = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] pci.alias                      = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] pci.device_spec                = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] pci.report_in_placement        = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.auth_section         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.auth_type            = password {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.cafile               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.certfile             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.collect_timing       = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.connect_retries      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.connect_retry_delay  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.default_domain_id    = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.default_domain_name  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.domain_id            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.domain_name          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.endpoint_override    = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.insecure             = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.keyfile              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.max_version          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.min_version          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.password             = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.project_domain_id    = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.project_domain_name  = Default {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.project_id           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.project_name         = service {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.region_name          = RegionOne {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.service_name         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.service_type         = placement {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.split_loggers        = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.status_code_retries  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.status_code_retry_delay = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.system_scope         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.timeout              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.trust_id             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.user_domain_id       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.user_domain_name     = Default {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.user_id              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.username             = placement {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] placement.version              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.cores                    = 20 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.count_usage_from_placement = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.injected_file_content_bytes = 10240 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.injected_file_path_length = 255 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.injected_files           = 5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.instances                = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.key_pairs                = 100 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:50 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.metadata_items           = 128 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.ram                      = 51200 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.recheck_quota            = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.server_group_members     = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] quota.server_groups            = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] rdp.enabled                    = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.image_metadata_prefilter = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.max_attempts         = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.max_placement_results = 1000 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.query_placement_for_image_type_support = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] scheduler.workers              = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.host_subset_size = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.isolated_hosts = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.isolated_images = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.pci_in_placement = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.track_instance_changes = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] metrics.required               = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] metrics.weight_multiplier      = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] metrics.weight_setting         = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] serial_console.enabled         = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] serial_console.port_range      = 10000:20000 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] serial_console.serialproxy_port = 6083 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.auth_section      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.auth_type         = password {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.cafile            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.certfile          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.collect_timing    = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.insecure          = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.keyfile           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.send_service_user_token = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.split_loggers     = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] service_user.timeout           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.agent_enabled            = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.enabled                  = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.html5proxy_port          = 6082 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.image_compression        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.jpeg_compression         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.playback_compression     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.server_listen            = 127.0.0.1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.streaming_mode           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] spice.zlib_compression         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] upgrade_levels.baseapi         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] upgrade_levels.cert            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] upgrade_levels.compute         = auto {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] upgrade_levels.conductor       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] upgrade_levels.scheduler       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vendordata_dynamic_auth.auth_section = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vendordata_dynamic_auth.auth_type = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vendordata_dynamic_auth.cafile = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vendordata_dynamic_auth.certfile = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vendordata_dynamic_auth.insecure = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vendordata_dynamic_auth.keyfile = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vendordata_dynamic_auth.timeout = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.api_retry_count         = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.ca_file                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.cache_prefix            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.cluster_name            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.connection_pool_size    = 10 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.console_delay_seconds   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.datastore_regex         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.host_ip                 = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.host_password           = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.host_port               = 443 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.host_username           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.insecure                = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.integration_bridge      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.maximum_objects         = 100 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.pbm_default_policy      = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.pbm_enabled             = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.pbm_wsdl_location       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.serial_port_proxy_uri   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.serial_port_service_uri = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.task_poll_interval      = 0.5 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.use_linked_clone        = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.vnc_keymap              = en-us {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.vnc_port                = 5900 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vmware.vnc_port_total          = 10000 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.auth_schemes               = ['none'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.enabled                    = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.novncproxy_port            = 6080 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.server_listen              = 0.0.0.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.vencrypt_ca_certs          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.vencrypt_client_cert       = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vnc.vencrypt_client_key        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.disable_rootwrap   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.enable_numa_live_migration = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.libvirt_disable_apic = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.client_socket_timeout     = 900 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.default_pool_size         = 1000 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.keep_alive                = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.max_header_line           = 16384 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.ssl_ca_file               = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.ssl_cert_file             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.ssl_key_file              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.tcp_keepidle              = 600 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] zvm.ca_file                    = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] zvm.cloud_connector_url        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] zvm.reachable_timeout          = 300 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.enforce_new_defaults = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.enforce_scope      = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.policy_default_rule = default {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.policy_file        = policy.yaml {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.connection_string     = messaging:// {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.enabled               = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.es_doc_type           = notification {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.es_scroll_size        = 10000 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.es_scroll_time        = 2m {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.filter_error_trace    = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.hmac_keys             = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.sentinel_service_name = mymaster {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.socket_timeout        = 0.1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.trace_requests        = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler.trace_sqlalchemy      = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler_jaeger.process_tags   = {} {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler_jaeger.service_name_prefix = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] profiler_otlp.service_name_prefix = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] remote_debug.host              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] remote_debug.port              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.ssl      = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_notifications.retry = -1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_messaging_notifications.transport_url = **** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.auth_section        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.auth_type           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.cafile              = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.certfile            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.collect_timing      = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.connect_retries     = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.connect_retry_delay = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.endpoint_id         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.endpoint_override   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.insecure            = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.keyfile             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.max_version         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.min_version         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.region_name         = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.service_name        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.service_type        = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.split_loggers       = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.status_code_retries = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.status_code_retry_delay = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.timeout             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.valid_interfaces    = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_limit.version             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_reports.file_event_handler = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] oslo_reports.log_dir           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_ovs_privileged.group  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] vif_plug_ovs_privileged.user   = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_linux_bridge.flat_interface = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_ovs.isolate_vif         = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_vif_ovs.per_port_bridge     = False {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] os_brick.lock_path             = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] privsep_osbrick.capabilities   = [21] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] privsep_osbrick.group          = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] privsep_osbrick.helper_command = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] privsep_osbrick.user           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] nova_sys_admin.group           = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] nova_sys_admin.helper_command  = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] nova_sys_admin.user            = None {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG oslo_service.service [None req-b10f2d73-c6b7-4dd1-b9f4-e0c5086f230a None None] ******************************************************************************** {{(pid=76442) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 20:30:51 user nova-compute[76442]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 20:30:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Connecting to libvirt: qemu:///system {{(pid=76442) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f070c57b160> {{(pid=76442) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 20:30:51 user nova-compute[76442]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 20:30:51 user nova-compute[76442]: WARNING nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 20:30:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f070c57b160> {{(pid=76442) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Starting native event thread {{(pid=76442) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Starting green dispatch thread {{(pid=76442) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 20:30:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Starting connection event dispatch thread {{(pid=76442) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 20:30:51 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Connection event '1' reason 'None'
Nov 14 20:30:51 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 20:30:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.mount [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Initialising _HostMountState generation 0 {{(pid=76442) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 20:30:58 user nova-compute[76442]: INFO nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt host capabilities <capabilities>
Nov 14 20:30:58 user nova-compute[76442]:   <host>
Nov 14 20:30:58 user nova-compute[76442]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 20:30:58 user nova-compute[76442]:     <cpu>
Nov 14 20:30:58 user nova-compute[76442]:       <arch>x86_64</arch>
Nov 14 20:30:58 user nova-compute[76442]:       <model>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <vendor>Intel</vendor>
Nov 14 20:30:58 user nova-compute[76442]:       <microcode version='1070'/>
Nov 14 20:30:58 user nova-compute[76442]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 20:30:58 user nova-compute[76442]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='ss'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='vmx'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='pcid'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='osxsave'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='hypervisor'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='arat'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='tsc_adjust'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='md-clear'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='arch-capabilities'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='invtsc'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='rsba'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 20:30:58 user nova-compute[76442]:       <pages unit='KiB' size='4'/>
Nov 14 20:30:58 user nova-compute[76442]:       <pages unit='KiB' size='2048'/>
Nov 14 20:30:58 user nova-compute[76442]:     </cpu>
Nov 14 20:30:58 user nova-compute[76442]:     <power_management>
Nov 14 20:30:58 user nova-compute[76442]:       <suspend_mem/>
Nov 14 20:30:58 user nova-compute[76442]:       <suspend_disk/>
Nov 14 20:30:58 user nova-compute[76442]:       <suspend_hybrid/>
Nov 14 20:30:58 user nova-compute[76442]:     </power_management>
Nov 14 20:30:58 user nova-compute[76442]:     <iommu support='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     <migration_features>
Nov 14 20:30:58 user nova-compute[76442]:       <live/>
Nov 14 20:30:58 user nova-compute[76442]:       <uri_transports>
Nov 14 20:30:58 user nova-compute[76442]:         <uri_transport>tcp</uri_transport>
Nov 14 20:30:58 user nova-compute[76442]:         <uri_transport>rdma</uri_transport>
Nov 14 20:30:58 user nova-compute[76442]:       </uri_transports>
Nov 14 20:30:58 user nova-compute[76442]:     </migration_features>
Nov 14 20:30:58 user nova-compute[76442]:     <topology>
Nov 14 20:30:58 user nova-compute[76442]:       <cells num='2'>
Nov 14 20:30:58 user nova-compute[76442]:         <cell id='0'>
Nov 14 20:30:58 user nova-compute[76442]:           <memory unit='KiB'>8140616</memory>
Nov 14 20:30:58 user nova-compute[76442]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 14 20:30:58 user nova-compute[76442]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 20:30:58 user nova-compute[76442]:           <distances>
Nov 14 20:30:58 user nova-compute[76442]:             <sibling id='0' value='10'/>
Nov 14 20:30:58 user nova-compute[76442]:             <sibling id='1' value='20'/>
Nov 14 20:30:58 user nova-compute[76442]:           </distances>
Nov 14 20:30:58 user nova-compute[76442]:           <cpus num='6'>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 20:30:58 user nova-compute[76442]:           </cpus>
Nov 14 20:30:58 user nova-compute[76442]:         </cell>
Nov 14 20:30:58 user nova-compute[76442]:         <cell id='1'>
Nov 14 20:30:58 user nova-compute[76442]:           <memory unit='KiB'>8255068</memory>
Nov 14 20:30:58 user nova-compute[76442]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 14 20:30:58 user nova-compute[76442]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 20:30:58 user nova-compute[76442]:           <distances>
Nov 14 20:30:58 user nova-compute[76442]:             <sibling id='0' value='20'/>
Nov 14 20:30:58 user nova-compute[76442]:             <sibling id='1' value='10'/>
Nov 14 20:30:58 user nova-compute[76442]:           </distances>
Nov 14 20:30:58 user nova-compute[76442]:           <cpus num='6'>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 20:30:58 user nova-compute[76442]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 20:30:58 user nova-compute[76442]:           </cpus>
Nov 14 20:30:58 user nova-compute[76442]:         </cell>
Nov 14 20:30:58 user nova-compute[76442]:       </cells>
Nov 14 20:30:58 user nova-compute[76442]:     </topology>
Nov 14 20:30:58 user nova-compute[76442]:     <cache>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 20:30:58 user nova-compute[76442]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 20:30:58 user nova-compute[76442]:     </cache>
Nov 14 20:30:58 user nova-compute[76442]:     <secmodel>
Nov 14 20:30:58 user nova-compute[76442]:       <model>apparmor</model>
Nov 14 20:30:58 user nova-compute[76442]:       <doi>0</doi>
Nov 14 20:30:58 user nova-compute[76442]:     </secmodel>
Nov 14 20:30:58 user nova-compute[76442]:     <secmodel>
Nov 14 20:30:58 user nova-compute[76442]:       <model>dac</model>
Nov 14 20:30:58 user nova-compute[76442]:       <doi>0</doi>
Nov 14 20:30:58 user nova-compute[76442]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 20:30:58 user nova-compute[76442]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 20:30:58 user nova-compute[76442]:     </secmodel>
Nov 14 20:30:58 user nova-compute[76442]:   </host>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='alpha'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>clipper</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='armv6l'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>spitz</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>nuri</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>kzm</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sx1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>z2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>tosa</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>n810</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>n800</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>terrier</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>midway</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>microbit</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>verdex</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>highbank</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>akita</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>connex</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>collie</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='armv7l'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>spitz</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>nuri</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>kzm</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sx1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>z2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>tosa</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>n810</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>n800</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>terrier</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>midway</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>microbit</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>verdex</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>highbank</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>akita</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>connex</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>collie</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='aarch64'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>spitz</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>nuri</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>kzm</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sx1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>z2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>tosa</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>n810</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>n800</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>terrier</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>midway</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>microbit</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>verdex</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>highbank</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>akita</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>connex</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>collie</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <acpi default='on' toggle='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='cris'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='i686'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>isapc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>microvm</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='kvm'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <pae/>
Nov 14 20:30:58 user nova-compute[76442]:       <nonpae/>
Nov 14 20:30:58 user nova-compute[76442]:       <acpi default='on' toggle='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:       <apic default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='m68k'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>an5206</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>q800</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='microblaze'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='microblazeel'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='mips'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='16'>malta</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='mipsel'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='16'>malta</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='mips64'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='16'>malta</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>pica61</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>magnum</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='mips64el'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='16'>malta</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>pica61</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>magnum</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='16'>boston</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='ppc'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mac99</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>40p</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>taihu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='ppc64'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>taihu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>40p</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mac99</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='ppc64le'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>taihu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>40p</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>mac99</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='riscv32'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='8'>spike</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='8'>virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='riscv64'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='8'>spike</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='8'>virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='s390x'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='sh4'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>shix</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>r2d</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='sh4eb'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>shix</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>r2d</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='sparc'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>LX</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='sparc64'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>niagara</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='x86_64'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>64</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='1'>isapc</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>microvm</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='kvm'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <acpi default='on' toggle='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:       <apic default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='xtensa'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>sim</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>kc705</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>ml605</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>lx200</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>lx60</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]:   <guest>
Nov 14 20:30:58 user nova-compute[76442]:     <os_type>hvm</os_type>
Nov 14 20:30:58 user nova-compute[76442]:     <arch name='xtensaeb'>
Nov 14 20:30:58 user nova-compute[76442]:       <wordsize>32</wordsize>
Nov 14 20:30:58 user nova-compute[76442]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='4'>sim</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>kc705</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>ml605</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>virt</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>lx200</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>lx60</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 20:30:58 user nova-compute[76442]:       <domain type='qemu'/>
Nov 14 20:30:58 user nova-compute[76442]:     </arch>
Nov 14 20:30:58 user nova-compute[76442]:     <features>
Nov 14 20:30:58 user nova-compute[76442]:       <cpuselection/>
Nov 14 20:30:58 user nova-compute[76442]:       <deviceboot/>
Nov 14 20:30:58 user nova-compute[76442]:       <disksnapshot default='on' toggle='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     </features>
Nov 14 20:30:58 user nova-compute[76442]:   </guest>
Nov 14 20:30:58 user nova-compute[76442]: </capabilities>
Nov 14 20:30:58 user nova-compute[76442]: 
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 20:30:58 user nova-compute[76442]: <domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 20:30:58 user nova-compute[76442]:   <domain>kvm</domain>
Nov 14 20:30:58 user nova-compute[76442]:   <machine>pc-q35-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:   <arch>i686</arch>
Nov 14 20:30:58 user nova-compute[76442]:   <vcpu max='288'/>
Nov 14 20:30:58 user nova-compute[76442]:   <iothreads supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:   <os supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='firmware'/>
Nov 14 20:30:58 user nova-compute[76442]:     <loader supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>rom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pflash</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='readonly'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='secure'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </loader>
Nov 14 20:30:58 user nova-compute[76442]:   </os>
Nov 14 20:30:58 user nova-compute[76442]:   <cpu>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-passthrough' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='hostPassthroughMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='maximum' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='maximumMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-model' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <vendor>Intel</vendor>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ss'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='vmx'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pcid'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='hypervisor'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arat'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='umip'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='md-clear'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibpb'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibrs'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='erms'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='lm'/>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='custom' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>qemu64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>qemu32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>phenom</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>n270</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>kvm64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>coreduo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>core2duo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>athlon</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Westmere</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Snowridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Penryn</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G5</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G4</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G1</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Nehalem</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Rome</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Milan</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Dhyana</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cooperlake</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Conroe</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>486</model>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:   </cpu>
Nov 14 20:30:58 user nova-compute[76442]:   <memoryBacking supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='sourceType'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>file</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>anonymous</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>memfd</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:   </memoryBacking>
Nov 14 20:30:58 user nova-compute[76442]:   <devices>
Nov 14 20:30:58 user nova-compute[76442]:     <disk supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='diskDevice'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>disk</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cdrom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>floppy</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>lun</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='bus'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>fdc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sata</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </disk>
Nov 14 20:30:58 user nova-compute[76442]:     <graphics supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sdl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vnc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>spice</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egl-headless</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </graphics>
Nov 14 20:30:58 user nova-compute[76442]:     <video supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='modelType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cirrus</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vmvga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>qxl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>none</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>bochs</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ramfb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </video>
Nov 14 20:30:58 user nova-compute[76442]:     <hostdev supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='mode'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>subsystem</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='startupPolicy'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>default</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>mandatory</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>requisite</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>optional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='subsysType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pci</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='capsType'/>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='pciBackend'/>
Nov 14 20:30:58 user nova-compute[76442]:     </hostdev>
Nov 14 20:30:58 user nova-compute[76442]:     <rng supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>random</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egd</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>builtin</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </rng>
Nov 14 20:30:58 user nova-compute[76442]:     <filesystem supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='driverType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>path</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>handle</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtiofs</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </filesystem>
Nov 14 20:30:58 user nova-compute[76442]:     <tpm supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-tis</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-crb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>passthrough</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>emulator</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </tpm>
Nov 14 20:30:58 user nova-compute[76442]:   </devices>
Nov 14 20:30:58 user nova-compute[76442]:   <features>
Nov 14 20:30:58 user nova-compute[76442]:     <gic supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     <vmcoreinfo supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <genid supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backingStoreInput supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backup supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <sev supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:   </features>
Nov 14 20:30:58 user nova-compute[76442]: </domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:  {{(pid=76442) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 20:30:58 user nova-compute[76442]: <domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 20:30:58 user nova-compute[76442]:   <domain>kvm</domain>
Nov 14 20:30:58 user nova-compute[76442]:   <machine>pc-i440fx-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:   <arch>i686</arch>
Nov 14 20:30:58 user nova-compute[76442]:   <vcpu max='255'/>
Nov 14 20:30:58 user nova-compute[76442]:   <iothreads supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:   <os supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='firmware'/>
Nov 14 20:30:58 user nova-compute[76442]:     <loader supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>rom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pflash</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='readonly'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='secure'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </loader>
Nov 14 20:30:58 user nova-compute[76442]:   </os>
Nov 14 20:30:58 user nova-compute[76442]:   <cpu>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-passthrough' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='hostPassthroughMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='maximum' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='maximumMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-model' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <vendor>Intel</vendor>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ss'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='vmx'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pcid'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='hypervisor'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arat'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='umip'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='md-clear'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibpb'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibrs'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='erms'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='lm'/>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='custom' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>qemu64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>qemu32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>phenom</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>n270</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>kvm64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>coreduo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>core2duo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>athlon</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Westmere</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Snowridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Penryn</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G5</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G4</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G1</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Nehalem</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Rome</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Milan</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Dhyana</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cooperlake</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Conroe</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>486</model>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:   </cpu>
Nov 14 20:30:58 user nova-compute[76442]:   <memoryBacking supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='sourceType'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>file</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>anonymous</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>memfd</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:   </memoryBacking>
Nov 14 20:30:58 user nova-compute[76442]:   <devices>
Nov 14 20:30:58 user nova-compute[76442]:     <disk supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='diskDevice'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>disk</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cdrom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>floppy</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>lun</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='bus'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ide</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>fdc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sata</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </disk>
Nov 14 20:30:58 user nova-compute[76442]:     <graphics supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sdl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vnc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>spice</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egl-headless</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </graphics>
Nov 14 20:30:58 user nova-compute[76442]:     <video supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='modelType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cirrus</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vmvga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>qxl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>none</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>bochs</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ramfb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </video>
Nov 14 20:30:58 user nova-compute[76442]:     <hostdev supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='mode'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>subsystem</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='startupPolicy'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>default</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>mandatory</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>requisite</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>optional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='subsysType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pci</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='capsType'/>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='pciBackend'/>
Nov 14 20:30:58 user nova-compute[76442]:     </hostdev>
Nov 14 20:30:58 user nova-compute[76442]:     <rng supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>random</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egd</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>builtin</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </rng>
Nov 14 20:30:58 user nova-compute[76442]:     <filesystem supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='driverType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>path</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>handle</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtiofs</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </filesystem>
Nov 14 20:30:58 user nova-compute[76442]:     <tpm supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-tis</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-crb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>passthrough</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>emulator</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </tpm>
Nov 14 20:30:58 user nova-compute[76442]:   </devices>
Nov 14 20:30:58 user nova-compute[76442]:   <features>
Nov 14 20:30:58 user nova-compute[76442]:     <gic supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     <vmcoreinfo supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <genid supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backingStoreInput supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backup supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <sev supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:   </features>
Nov 14 20:30:58 user nova-compute[76442]: </domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:  {{(pid=76442) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 20:30:58 user nova-compute[76442]: <domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 20:30:58 user nova-compute[76442]:   <domain>kvm</domain>
Nov 14 20:30:58 user nova-compute[76442]:   <machine>pc-q35-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:   <arch>i686</arch>
Nov 14 20:30:58 user nova-compute[76442]:   <vcpu max='288'/>
Nov 14 20:30:58 user nova-compute[76442]:   <iothreads supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:   <os supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='firmware'/>
Nov 14 20:30:58 user nova-compute[76442]:     <loader supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>rom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pflash</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='readonly'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='secure'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </loader>
Nov 14 20:30:58 user nova-compute[76442]:   </os>
Nov 14 20:30:58 user nova-compute[76442]:   <cpu>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-passthrough' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='hostPassthroughMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='maximum' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='maximumMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-model' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <vendor>Intel</vendor>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ss'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='vmx'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pcid'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='hypervisor'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arat'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='umip'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='md-clear'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibpb'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibrs'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='erms'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='lm'/>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='custom' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>qemu64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>qemu32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>phenom</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>n270</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>kvm64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>coreduo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>core2duo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>athlon</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Westmere</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Snowridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Penryn</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G5</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G4</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G1</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Nehalem</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Rome</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Milan</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Dhyana</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cooperlake</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Conroe</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>486</model>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:   </cpu>
Nov 14 20:30:58 user nova-compute[76442]:   <memoryBacking supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='sourceType'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>file</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>anonymous</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>memfd</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:   </memoryBacking>
Nov 14 20:30:58 user nova-compute[76442]:   <devices>
Nov 14 20:30:58 user nova-compute[76442]:     <disk supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='diskDevice'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>disk</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cdrom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>floppy</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>lun</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='bus'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>fdc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sata</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </disk>
Nov 14 20:30:58 user nova-compute[76442]:     <graphics supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sdl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vnc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>spice</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egl-headless</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </graphics>
Nov 14 20:30:58 user nova-compute[76442]:     <video supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='modelType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cirrus</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vmvga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>qxl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>none</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>bochs</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ramfb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </video>
Nov 14 20:30:58 user nova-compute[76442]:     <hostdev supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='mode'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>subsystem</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='startupPolicy'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>default</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>mandatory</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>requisite</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>optional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='subsysType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pci</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='capsType'/>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='pciBackend'/>
Nov 14 20:30:58 user nova-compute[76442]:     </hostdev>
Nov 14 20:30:58 user nova-compute[76442]:     <rng supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>random</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egd</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>builtin</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </rng>
Nov 14 20:30:58 user nova-compute[76442]:     <filesystem supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='driverType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>path</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>handle</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtiofs</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </filesystem>
Nov 14 20:30:58 user nova-compute[76442]:     <tpm supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-tis</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-crb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>passthrough</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>emulator</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </tpm>
Nov 14 20:30:58 user nova-compute[76442]:   </devices>
Nov 14 20:30:58 user nova-compute[76442]:   <features>
Nov 14 20:30:58 user nova-compute[76442]:     <gic supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     <vmcoreinfo supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <genid supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backingStoreInput supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backup supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <sev supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:   </features>
Nov 14 20:30:58 user nova-compute[76442]: </domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:  {{(pid=76442) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 20:30:58 user nova-compute[76442]: <domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 20:30:58 user nova-compute[76442]:   <domain>kvm</domain>
Nov 14 20:30:58 user nova-compute[76442]:   <machine>pc-i440fx-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:   <arch>i686</arch>
Nov 14 20:30:58 user nova-compute[76442]:   <vcpu max='255'/>
Nov 14 20:30:58 user nova-compute[76442]:   <iothreads supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:   <os supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='firmware'/>
Nov 14 20:30:58 user nova-compute[76442]:     <loader supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>rom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pflash</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='readonly'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='secure'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </loader>
Nov 14 20:30:58 user nova-compute[76442]:   </os>
Nov 14 20:30:58 user nova-compute[76442]:   <cpu>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-passthrough' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='hostPassthroughMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='maximum' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='maximumMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-model' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <vendor>Intel</vendor>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ss'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='vmx'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pcid'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='hypervisor'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arat'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='umip'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='md-clear'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibpb'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibrs'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='erms'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='lm'/>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='custom' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>qemu64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>qemu32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>phenom</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>n270</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>kvm64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>coreduo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>core2duo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>athlon</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Westmere</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Snowridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Penryn</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G5</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G4</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G1</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Nehalem</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Rome</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Milan</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Dhyana</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cooperlake</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Conroe</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>486</model>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:   </cpu>
Nov 14 20:30:58 user nova-compute[76442]:   <memoryBacking supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='sourceType'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>file</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>anonymous</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>memfd</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:   </memoryBacking>
Nov 14 20:30:58 user nova-compute[76442]:   <devices>
Nov 14 20:30:58 user nova-compute[76442]:     <disk supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='diskDevice'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>disk</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cdrom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>floppy</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>lun</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='bus'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ide</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>fdc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sata</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </disk>
Nov 14 20:30:58 user nova-compute[76442]:     <graphics supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sdl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vnc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>spice</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egl-headless</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </graphics>
Nov 14 20:30:58 user nova-compute[76442]:     <video supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='modelType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cirrus</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vmvga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>qxl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>none</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>bochs</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ramfb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </video>
Nov 14 20:30:58 user nova-compute[76442]:     <hostdev supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='mode'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>subsystem</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='startupPolicy'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>default</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>mandatory</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>requisite</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>optional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='subsysType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pci</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='capsType'/>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='pciBackend'/>
Nov 14 20:30:58 user nova-compute[76442]:     </hostdev>
Nov 14 20:30:58 user nova-compute[76442]:     <rng supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>random</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egd</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>builtin</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </rng>
Nov 14 20:30:58 user nova-compute[76442]:     <filesystem supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='driverType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>path</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>handle</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtiofs</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </filesystem>
Nov 14 20:30:58 user nova-compute[76442]:     <tpm supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-tis</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-crb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>passthrough</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>emulator</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </tpm>
Nov 14 20:30:58 user nova-compute[76442]:   </devices>
Nov 14 20:30:58 user nova-compute[76442]:   <features>
Nov 14 20:30:58 user nova-compute[76442]:     <gic supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     <vmcoreinfo supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <genid supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backingStoreInput supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backup supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <sev supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:   </features>
Nov 14 20:30:58 user nova-compute[76442]: </domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:  {{(pid=76442) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 20:30:58 user nova-compute[76442]: <domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 20:30:58 user nova-compute[76442]:   <domain>kvm</domain>
Nov 14 20:30:58 user nova-compute[76442]:   <machine>pc-q35-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:   <arch>x86_64</arch>
Nov 14 20:30:58 user nova-compute[76442]:   <vcpu max='288'/>
Nov 14 20:30:58 user nova-compute[76442]:   <iothreads supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:   <os supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='firmware'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>efi</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:     <loader supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>rom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pflash</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='readonly'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='secure'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </loader>
Nov 14 20:30:58 user nova-compute[76442]:   </os>
Nov 14 20:30:58 user nova-compute[76442]:   <cpu>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-passthrough' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='hostPassthroughMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='maximum' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='maximumMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-model' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <vendor>Intel</vendor>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ss'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='vmx'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pcid'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='hypervisor'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arat'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='umip'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='md-clear'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='invtsc'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibpb'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibrs'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='rsba'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='erms'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='custom' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>qemu64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>qemu32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>phenom</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>n270</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>coreduo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>core2duo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>athlon</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Westmere</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Snowridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Penryn</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G5</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G4</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Opteron_G1</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Nehalem</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Rome</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Milan</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Dhyana</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cooperlake</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Conroe</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>486</model>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:   </cpu>
Nov 14 20:30:58 user nova-compute[76442]:   <memoryBacking supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='sourceType'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>file</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>anonymous</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>memfd</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:   </memoryBacking>
Nov 14 20:30:58 user nova-compute[76442]:   <devices>
Nov 14 20:30:58 user nova-compute[76442]:     <disk supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='diskDevice'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>disk</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cdrom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>floppy</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>lun</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='bus'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>fdc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sata</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </disk>
Nov 14 20:30:58 user nova-compute[76442]:     <graphics supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sdl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vnc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>spice</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egl-headless</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </graphics>
Nov 14 20:30:58 user nova-compute[76442]:     <video supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='modelType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cirrus</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vmvga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>qxl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>none</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>bochs</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ramfb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </video>
Nov 14 20:30:58 user nova-compute[76442]:     <hostdev supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='mode'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>subsystem</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='startupPolicy'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>default</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>mandatory</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>requisite</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>optional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='subsysType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pci</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='capsType'/>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='pciBackend'/>
Nov 14 20:30:58 user nova-compute[76442]:     </hostdev>
Nov 14 20:30:58 user nova-compute[76442]:     <rng supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>random</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egd</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>builtin</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </rng>
Nov 14 20:30:58 user nova-compute[76442]:     <filesystem supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='driverType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>path</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>handle</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtiofs</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </filesystem>
Nov 14 20:30:58 user nova-compute[76442]:     <tpm supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-tis</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-crb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>passthrough</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>emulator</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </tpm>
Nov 14 20:30:58 user nova-compute[76442]:   </devices>
Nov 14 20:30:58 user nova-compute[76442]:   <features>
Nov 14 20:30:58 user nova-compute[76442]:     <gic supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     <vmcoreinfo supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <genid supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backingStoreInput supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backup supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <sev supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:   </features>
Nov 14 20:30:58 user nova-compute[76442]: </domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:  {{(pid=76442) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 20:30:58 user nova-compute[76442]: <domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 20:30:58 user nova-compute[76442]:   <domain>kvm</domain>
Nov 14 20:30:58 user nova-compute[76442]:   <machine>pc-i440fx-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:   <arch>x86_64</arch>
Nov 14 20:30:58 user nova-compute[76442]:   <vcpu max='255'/>
Nov 14 20:30:58 user nova-compute[76442]:   <iothreads supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:   <os supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='firmware'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>efi</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:     <loader supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>rom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pflash</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='readonly'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='secure'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </loader>
Nov 14 20:30:58 user nova-compute[76442]:   </os>
Nov 14 20:30:58 user nova-compute[76442]:   <cpu>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-passthrough' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='hostPassthroughMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='maximum' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='maximumMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-model' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <vendor>Intel</vendor>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ss'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='vmx'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pcid'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='hypervisor'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arat'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='umip'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='md-clear'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='invtsc'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibpb'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibrs'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='rsba'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='erms'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='custom' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>qemu64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>qemu32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>phenom</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>n270</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>coreduo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>core2duo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>athlon</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Westmere</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Snowridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Penryn</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G5</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G4</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Opteron_G1</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Nehalem</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Rome</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Milan</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Dhyana</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cooperlake</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Conroe</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>486</model>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:   </cpu>
Nov 14 20:30:58 user nova-compute[76442]:   <memoryBacking supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='sourceType'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>file</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>anonymous</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>memfd</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:   </memoryBacking>
Nov 14 20:30:58 user nova-compute[76442]:   <devices>
Nov 14 20:30:58 user nova-compute[76442]:     <disk supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='diskDevice'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>disk</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cdrom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>floppy</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>lun</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='bus'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ide</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>fdc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sata</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </disk>
Nov 14 20:30:58 user nova-compute[76442]:     <graphics supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sdl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vnc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>spice</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egl-headless</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </graphics>
Nov 14 20:30:58 user nova-compute[76442]:     <video supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='modelType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cirrus</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vmvga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>qxl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>none</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>bochs</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ramfb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </video>
Nov 14 20:30:58 user nova-compute[76442]:     <hostdev supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='mode'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>subsystem</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='startupPolicy'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>default</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>mandatory</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>requisite</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>optional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='subsysType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pci</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='capsType'/>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='pciBackend'/>
Nov 14 20:30:58 user nova-compute[76442]:     </hostdev>
Nov 14 20:30:58 user nova-compute[76442]:     <rng supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>random</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egd</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>builtin</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </rng>
Nov 14 20:30:58 user nova-compute[76442]:     <filesystem supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='driverType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>path</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>handle</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtiofs</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </filesystem>
Nov 14 20:30:58 user nova-compute[76442]:     <tpm supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-tis</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-crb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>passthrough</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>emulator</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </tpm>
Nov 14 20:30:58 user nova-compute[76442]:   </devices>
Nov 14 20:30:58 user nova-compute[76442]:   <features>
Nov 14 20:30:58 user nova-compute[76442]:     <gic supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     <vmcoreinfo supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <genid supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backingStoreInput supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backup supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <sev supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:   </features>
Nov 14 20:30:58 user nova-compute[76442]: </domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:  {{(pid=76442) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 20:30:58 user nova-compute[76442]: <domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 20:30:58 user nova-compute[76442]:   <domain>kvm</domain>
Nov 14 20:30:58 user nova-compute[76442]:   <machine>pc-q35-jammy</machine>
Nov 14 20:30:58 user nova-compute[76442]:   <arch>x86_64</arch>
Nov 14 20:30:58 user nova-compute[76442]:   <vcpu max='288'/>
Nov 14 20:30:58 user nova-compute[76442]:   <iothreads supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:   <os supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='firmware'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>efi</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:     <loader supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>rom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pflash</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='readonly'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='secure'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </loader>
Nov 14 20:30:58 user nova-compute[76442]:   </os>
Nov 14 20:30:58 user nova-compute[76442]:   <cpu>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-passthrough' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='hostPassthroughMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='maximum' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='maximumMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-model' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <vendor>Intel</vendor>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ss'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='vmx'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pcid'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='hypervisor'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arat'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='umip'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='md-clear'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='invtsc'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibpb'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibrs'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='rsba'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='erms'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='custom' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>qemu64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>qemu32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>phenom</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>n270</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>coreduo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>core2duo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>athlon</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Westmere</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Snowridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Penryn</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G5</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G4</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Opteron_G1</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Nehalem</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Rome</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Milan</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Dhyana</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cooperlake</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Conroe</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>486</model>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:   </cpu>
Nov 14 20:30:58 user nova-compute[76442]:   <memoryBacking supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='sourceType'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>file</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>anonymous</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>memfd</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:   </memoryBacking>
Nov 14 20:30:58 user nova-compute[76442]:   <devices>
Nov 14 20:30:58 user nova-compute[76442]:     <disk supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='diskDevice'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>disk</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cdrom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>floppy</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>lun</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='bus'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>fdc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sata</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </disk>
Nov 14 20:30:58 user nova-compute[76442]:     <graphics supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sdl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vnc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>spice</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egl-headless</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </graphics>
Nov 14 20:30:58 user nova-compute[76442]:     <video supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='modelType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cirrus</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vmvga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>qxl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>none</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>bochs</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ramfb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </video>
Nov 14 20:30:58 user nova-compute[76442]:     <hostdev supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='mode'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>subsystem</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='startupPolicy'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>default</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>mandatory</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>requisite</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>optional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='subsysType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pci</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='capsType'/>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='pciBackend'/>
Nov 14 20:30:58 user nova-compute[76442]:     </hostdev>
Nov 14 20:30:58 user nova-compute[76442]:     <rng supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>random</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egd</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>builtin</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </rng>
Nov 14 20:30:58 user nova-compute[76442]:     <filesystem supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='driverType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>path</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>handle</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtiofs</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </filesystem>
Nov 14 20:30:58 user nova-compute[76442]:     <tpm supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-tis</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-crb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>passthrough</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>emulator</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </tpm>
Nov 14 20:30:58 user nova-compute[76442]:   </devices>
Nov 14 20:30:58 user nova-compute[76442]:   <features>
Nov 14 20:30:58 user nova-compute[76442]:     <gic supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     <vmcoreinfo supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <genid supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backingStoreInput supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backup supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <sev supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:   </features>
Nov 14 20:30:58 user nova-compute[76442]: </domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:  {{(pid=76442) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 20:30:58 user nova-compute[76442]: <domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 20:30:58 user nova-compute[76442]:   <domain>kvm</domain>
Nov 14 20:30:58 user nova-compute[76442]:   <machine>pc-i440fx-6.2</machine>
Nov 14 20:30:58 user nova-compute[76442]:   <arch>x86_64</arch>
Nov 14 20:30:58 user nova-compute[76442]:   <vcpu max='255'/>
Nov 14 20:30:58 user nova-compute[76442]:   <iothreads supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:   <os supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='firmware'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>efi</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:     <loader supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>rom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pflash</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='readonly'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>yes</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='secure'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>no</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </loader>
Nov 14 20:30:58 user nova-compute[76442]:   </os>
Nov 14 20:30:58 user nova-compute[76442]:   <cpu>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-passthrough' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='hostPassthroughMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='maximum' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='maximumMigratable'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>on</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>off</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='host-model' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <vendor>Intel</vendor>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ss'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='vmx'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pcid'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='hypervisor'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arat'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='umip'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='md-clear'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='invtsc'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibpb'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='ibrs'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-stibp'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='rsba'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='erms'/>
Nov 14 20:30:58 user nova-compute[76442]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:     <mode name='custom' supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>qemu64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>qemu32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>phenom</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>pentium</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>n270</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm64</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>kvm32</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>coreduo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>core2duo</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>athlon</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Westmere</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Snowridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Skylake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>SandyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Penryn</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G5</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G4</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G3</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Opteron_G2</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Opteron_G1</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Nehalem</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>IvyBridge</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Icelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Haswell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Rome</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-Milan</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>EPYC</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Dhyana</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cooperlake</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>Conroe</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='no'>Broadwell</model>
Nov 14 20:30:58 user nova-compute[76442]:       <model usable='yes'>486</model>
Nov 14 20:30:58 user nova-compute[76442]:     </mode>
Nov 14 20:30:58 user nova-compute[76442]:   </cpu>
Nov 14 20:30:58 user nova-compute[76442]:   <memoryBacking supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:     <enum name='sourceType'>
Nov 14 20:30:58 user nova-compute[76442]:       <value>file</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>anonymous</value>
Nov 14 20:30:58 user nova-compute[76442]:       <value>memfd</value>
Nov 14 20:30:58 user nova-compute[76442]:     </enum>
Nov 14 20:30:58 user nova-compute[76442]:   </memoryBacking>
Nov 14 20:30:58 user nova-compute[76442]:   <devices>
Nov 14 20:30:58 user nova-compute[76442]:     <disk supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='diskDevice'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>disk</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cdrom</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>floppy</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>lun</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='bus'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ide</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>fdc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sata</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </disk>
Nov 14 20:30:58 user nova-compute[76442]:     <graphics supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='type'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>sdl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vnc</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>spice</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egl-headless</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </graphics>
Nov 14 20:30:58 user nova-compute[76442]:     <video supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='modelType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>cirrus</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>vmvga</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>qxl</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>none</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>bochs</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>ramfb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </video>
Nov 14 20:30:58 user nova-compute[76442]:     <hostdev supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='mode'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>subsystem</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='startupPolicy'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>default</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>mandatory</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>requisite</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>optional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='subsysType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>usb</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>pci</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>scsi</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='capsType'/>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='pciBackend'/>
Nov 14 20:30:58 user nova-compute[76442]:     </hostdev>
Nov 14 20:30:58 user nova-compute[76442]:     <rng supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtio-non-transitional</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>random</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>egd</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>builtin</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </rng>
Nov 14 20:30:58 user nova-compute[76442]:     <filesystem supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='driverType'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>path</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>handle</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>virtiofs</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </filesystem>
Nov 14 20:30:58 user nova-compute[76442]:     <tpm supported='yes'>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='model'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-tis</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>tpm-crb</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:       <enum name='backendModel'>
Nov 14 20:30:58 user nova-compute[76442]:         <value>passthrough</value>
Nov 14 20:30:58 user nova-compute[76442]:         <value>emulator</value>
Nov 14 20:30:58 user nova-compute[76442]:       </enum>
Nov 14 20:30:58 user nova-compute[76442]:     </tpm>
Nov 14 20:30:58 user nova-compute[76442]:   </devices>
Nov 14 20:30:58 user nova-compute[76442]:   <features>
Nov 14 20:30:58 user nova-compute[76442]:     <gic supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:     <vmcoreinfo supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <genid supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backingStoreInput supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <backup supported='yes'/>
Nov 14 20:30:58 user nova-compute[76442]:     <sev supported='no'/>
Nov 14 20:30:58 user nova-compute[76442]:   </features>
Nov 14 20:30:58 user nova-compute[76442]: </domainCapabilities>
Nov 14 20:30:58 user nova-compute[76442]:  {{(pid=76442) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=76442) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=76442) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Checking secure boot support for host arch (x86_64) {{(pid=76442) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 20:30:58 user nova-compute[76442]: INFO nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Secure Boot support detected
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] cpu compare xml: <cpu match="exact">
Nov 14 20:30:58 user nova-compute[76442]:   <model>Nehalem</model>
Nov 14 20:30:58 user nova-compute[76442]: </cpu>
Nov 14 20:30:58 user nova-compute[76442]:  {{(pid=76442) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 20:30:58 user nova-compute[76442]: INFO nova.virt.node [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Generated node identity 8fc56580-8aa8-4b89-aaa5-43465a1eed3f
Nov 14 20:30:58 user nova-compute[76442]: INFO nova.virt.node [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Wrote node identity 8fc56580-8aa8-4b89-aaa5-43465a1eed3f to /opt/stack/data/nova/compute_id
Nov 14 20:30:58 user nova-compute[76442]: WARNING nova.compute.manager [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Compute nodes ['8fc56580-8aa8-4b89-aaa5-43465a1eed3f'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 20:30:58 user nova-compute[76442]: INFO nova.compute.manager [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 20:30:58 user nova-compute[76442]: WARNING nova.compute.manager [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 20:30:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:30:58 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:30:59 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:30:59 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Hypervisor/Node resource view: name=user free_ram=11034MB free_disk=26.17538070678711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:30:59 user nova-compute[76442]: WARNING nova.compute.resource_tracker [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] No compute node record for user:8fc56580-8aa8-4b89-aaa5-43465a1eed3f: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8fc56580-8aa8-4b89-aaa5-43465a1eed3f could not be found.
Nov 14 20:30:59 user nova-compute[76442]: INFO nova.compute.resource_tracker [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Compute node record created for user:user with uuid: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:30:59 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] [req-e9c5109e-069d-466e-a53d-842872ef9e50] Created resource provider record via placement API for resource provider with UUID 8fc56580-8aa8-4b89-aaa5-43465a1eed3f and name user.
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=76442) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 20:30:59 user nova-compute[76442]: INFO nova.virt.libvirt.host [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] kernel doesn't support AMD SEV
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Libvirt baseline CPU <cpu>
Nov 14 20:30:59 user nova-compute[76442]:   <arch>x86_64</arch>
Nov 14 20:30:59 user nova-compute[76442]:   <model>Nehalem</model>
Nov 14 20:30:59 user nova-compute[76442]:   <vendor>Intel</vendor>
Nov 14 20:30:59 user nova-compute[76442]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 20:30:59 user nova-compute[76442]: </cpu>
Nov 14 20:30:59 user nova-compute[76442]:  {{(pid=76442) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Updated inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Updating resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f generation from 0 to 1 during operation: update_inventory {{(pid=76442) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Updating resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f generation from 1 to 2 during operation: update_traits {{(pid=76442) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.service [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Creating RPC server for service compute {{(pid=76442) start /opt/stack/nova/nova/service.py:182}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.service [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] Join ServiceGroup membership for this service compute {{(pid=76442) start /opt/stack/nova/nova/service.py:199}}
Nov 14 20:30:59 user nova-compute[76442]: DEBUG nova.servicegroup.drivers.db [None req-ff58eceb-88d2-45cd-8edd-b61f549ecae7 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=76442) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 20:31:05 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_power_states {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:05 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:31:50 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:31:50 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=10468MB free_disk=26.078990936279297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:31:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:32:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:32:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:32:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=10366MB free_disk=26.13156509399414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:32:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:33:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:33:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:33:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:33:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:33:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:33:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:33:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:33:53 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:33:53 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=10326MB free_disk=25.895774841308594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:33:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:33:54 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:34:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:34:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:34:52 user nova-compute[76442]: INFO nova.compute.claims [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Claim successful on node user
Nov 14 20:34:52 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:34:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:34:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:34:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Creating image(s)
Nov 14 20:34:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "/opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "/opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:34:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG nova.policy [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4163211b006c4fbbbdc575c0e6d02ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83568ed733848d09643843927ca0c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6.part --force-share --output=json" returned: 0 in 0.165s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG nova.virt.images [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] c456f24a-ee5e-4551-88d7-a8348db880df was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6.part /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6.part /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6.converted" returned: 0 in 0.143s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:34:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:34:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:34:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.121s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:34:54 user nova-compute[76442]: INFO oslo.privsep.daemon [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnwiz57wv/privsep.sock']
Nov 14 20:34:54 user sudo[85678]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnwiz57wv/privsep.sock
Nov 14 20:34:54 user sudo[85678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 20:34:54 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:54 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Successfully created port: 8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:34:55 user sudo[85678]: pam_unix(sudo:session): session closed for user root
Nov 14 20:34:55 user nova-compute[76442]: INFO oslo.privsep.daemon [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Spawned new privsep daemon via rootwrap
Nov 14 20:34:55 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 20:34:55 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 20:34:55 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 20:34:55 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85681
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Skipping network cache update for instance because it is Building. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.389s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:34:55 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:34:55 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:34:55 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9560MB free_disk=25.87457275390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:34:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.208s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk 1073741824" returned: 0 in 0.060s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Cannot resize image /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Ensure instance console log exists: /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:34:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:34:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Successfully updated port: 8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:34:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:34:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquired lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:34:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:34:58 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:34:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-eb8615ae-c7f6-4d06-8080-c54ca64abfab req-be6e7c64-37fd-42ca-b7dd-265b28a4e99c service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-changed-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:34:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-eb8615ae-c7f6-4d06-8080-c54ca64abfab req-be6e7c64-37fd-42ca-b7dd-265b28a4e99c service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Refreshing instance network info cache due to event network-changed-8de88348-392e-4efb-aa6c-4f7cd492a169. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:34:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-eb8615ae-c7f6-4d06-8080-c54ca64abfab req-be6e7c64-37fd-42ca-b7dd-265b28a4e99c service nova] Acquiring lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updating instance_info_cache with network_info: [{"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Releasing lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Instance network_info: |[{"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-eb8615ae-c7f6-4d06-8080-c54ca64abfab req-be6e7c64-37fd-42ca-b7dd-265b28a4e99c service nova] Acquired lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.network.neutron [req-eb8615ae-c7f6-4d06-8080-c54ca64abfab req-be6e7c64-37fd-42ca-b7dd-265b28a4e99c service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Refreshing network info cache for port 8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Start _get_guest_xml network_info=[{"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:34:59 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:34:59 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:34:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1724729418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1724729418',id=1,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-0j4f3cba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:34:53Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=a5970cb5-3f09-43c8-93ac-03053bc2f2cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:40:36,bridge_name='br-int',has_traffic_filtering=True,id=8de88348-392e-4efb-aa6c-4f7cd492a169,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de88348-39') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.objects.instance [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'pci_devices' on Instance uuid a5970cb5-3f09-43c8-93ac-03053bc2f2cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:34:59 user nova-compute[76442]:   <uuid>a5970cb5-3f09-43c8-93ac-03053bc2f2cc</uuid>
Nov 14 20:34:59 user nova-compute[76442]:   <name>instance-00000001</name>
Nov 14 20:34:59 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:34:59 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:34:59 user nova-compute[76442]:   <metadata>
Nov 14 20:34:59 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:34:59 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:34:59 user nova-compute[76442]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1724729418</nova:name>
Nov 14 20:34:59 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:34:59</nova:creationTime>
Nov 14 20:34:59 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:34:59 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:34:59 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:34:59 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:34:59 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:34:59 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:34:59 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:34:59 user nova-compute[76442]:       <nova:owner>
Nov 14 20:34:59 user nova-compute[76442]:         <nova:user uuid="4163211b006c4fbbbdc575c0e6d02ac8">tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member</nova:user>
Nov 14 20:34:59 user nova-compute[76442]:         <nova:project uuid="f83568ed733848d09643843927ca0c42">tempest-ServerBootFromVolumeStableRescueTest-1547619353</nova:project>
Nov 14 20:34:59 user nova-compute[76442]:       </nova:owner>
Nov 14 20:34:59 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:34:59 user nova-compute[76442]:       <nova:ports>
Nov 14 20:34:59 user nova-compute[76442]:         <nova:port uuid="8de88348-392e-4efb-aa6c-4f7cd492a169">
Nov 14 20:34:59 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 20:34:59 user nova-compute[76442]:         </nova:port>
Nov 14 20:34:59 user nova-compute[76442]:       </nova:ports>
Nov 14 20:34:59 user nova-compute[76442]:     </nova:instance>
Nov 14 20:34:59 user nova-compute[76442]:   </metadata>
Nov 14 20:34:59 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:34:59 user nova-compute[76442]:     <system>
Nov 14 20:34:59 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:34:59 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:34:59 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:34:59 user nova-compute[76442]:       <entry name="serial">a5970cb5-3f09-43c8-93ac-03053bc2f2cc</entry>
Nov 14 20:34:59 user nova-compute[76442]:       <entry name="uuid">a5970cb5-3f09-43c8-93ac-03053bc2f2cc</entry>
Nov 14 20:34:59 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:34:59 user nova-compute[76442]:     </system>
Nov 14 20:34:59 user nova-compute[76442]:   </sysinfo>
Nov 14 20:34:59 user nova-compute[76442]:   <os>
Nov 14 20:34:59 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:34:59 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:34:59 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:34:59 user nova-compute[76442]:   </os>
Nov 14 20:34:59 user nova-compute[76442]:   <features>
Nov 14 20:34:59 user nova-compute[76442]:     <acpi/>
Nov 14 20:34:59 user nova-compute[76442]:     <apic/>
Nov 14 20:34:59 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:34:59 user nova-compute[76442]:   </features>
Nov 14 20:34:59 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:34:59 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:34:59 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:34:59 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:34:59 user nova-compute[76442]:   </clock>
Nov 14 20:34:59 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:34:59 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:34:59 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:34:59 user nova-compute[76442]:   </cpu>
Nov 14 20:34:59 user nova-compute[76442]:   <devices>
Nov 14 20:34:59 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:34:59 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:34:59 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk"/>
Nov 14 20:34:59 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:34:59 user nova-compute[76442]:     </disk>
Nov 14 20:34:59 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:34:59 user nova-compute[76442]:       <mac address="fa:16:3e:2f:40:36"/>
Nov 14 20:34:59 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:34:59 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:34:59 user nova-compute[76442]:       <target dev="tap8de88348-39"/>
Nov 14 20:34:59 user nova-compute[76442]:     </interface>
Nov 14 20:34:59 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:34:59 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/console.log" append="off"/>
Nov 14 20:34:59 user nova-compute[76442]:     </serial>
Nov 14 20:34:59 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:34:59 user nova-compute[76442]:     <video>
Nov 14 20:34:59 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:34:59 user nova-compute[76442]:     </video>
Nov 14 20:34:59 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:34:59 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:34:59 user nova-compute[76442]:     </rng>
Nov 14 20:34:59 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:34:59 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:34:59 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:34:59 user nova-compute[76442]:     </memballoon>
Nov 14 20:34:59 user nova-compute[76442]:   </devices>
Nov 14 20:34:59 user nova-compute[76442]: </domain>
Nov 14 20:34:59 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:34:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1724729418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1724729418',id=1,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-0j4f3cba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:34:53Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=a5970cb5-3f09-43c8-93ac-03053bc2f2cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:40:36,bridge_name='br-int',has_traffic_filtering=True,id=8de88348-392e-4efb-aa6c-4f7cd492a169,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de88348-39') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG os_vif [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:40:36,bridge_name='br-int',has_traffic_filtering=True,id=8de88348-392e-4efb-aa6c-4f7cd492a169,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de88348-39') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Created schema index Interface.name {{(pid=76442) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Created schema index Port.name {{(pid=76442) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Created schema index Bridge.name {{(pid=76442) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [POLLOUT] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf85e789-281f-5213-a016-8e45e90e9e81', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:34:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:34:59 user nova-compute[76442]: INFO oslo.privsep.daemon [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpw22tsc19/privsep.sock']
Nov 14 20:34:59 user sudo[85704]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpw22tsc19/privsep.sock
Nov 14 20:34:59 user sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 20:35:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "15e2beda-544e-419b-b345-99f439670e0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:35:00 user nova-compute[76442]: INFO nova.compute.claims [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Claim successful on node user
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.network.neutron [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:35:00 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:35:00 user sudo[85704]: pam_unix(sudo:session): session closed for user root
Nov 14 20:35:00 user nova-compute[76442]: INFO oslo.privsep.daemon [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Spawned new privsep daemon via rootwrap
Nov 14 20:35:00 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 20:35:00 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 20:35:00 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 20:35:00 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85712
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.network.neutron [req-eb8615ae-c7f6-4d06-8080-c54ca64abfab req-be6e7c64-37fd-42ca-b7dd-265b28a4e99c service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updated VIF entry in instance network info cache for port 8de88348-392e-4efb-aa6c-4f7cd492a169. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.network.neutron [req-eb8615ae-c7f6-4d06-8080-c54ca64abfab req-be6e7c64-37fd-42ca-b7dd-265b28a4e99c service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updating instance_info_cache with network_info: [{"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:35:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-eb8615ae-c7f6-4d06-8080-c54ca64abfab req-be6e7c64-37fd-42ca-b7dd-265b28a4e99c service nova] Releasing lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:35:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Creating image(s)
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "/opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "/opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "/opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG nova.policy [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b31c6c6a4eb4237a2ed349b300573b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8b97ba534f4544b0aa7d2fce1a97cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk 1073741824" returned: 0 in 0.126s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8de88348-39, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8de88348-39, col_values=(('qos', UUID('717eaa85-a7a1-4fac-90c9-eb1359ed0348')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8de88348-39, col_values=(('external_ids', {'iface-id': '8de88348-392e-4efb-aa6c-4f7cd492a169', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:40:36', 'vm-uuid': 'a5970cb5-3f09-43c8-93ac-03053bc2f2cc'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:01 user nova-compute[76442]: INFO os_vif [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:40:36,bridge_name='br-int',has_traffic_filtering=True,id=8de88348-392e-4efb-aa6c-4f7cd492a169,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de88348-39')
Nov 14 20:35:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No VIF found with MAC fa:16:3e:2f:40:36, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Cannot resize image /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Ensure instance console log exists: /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:03 user nova-compute[76442]: DEBUG nova.network.neutron [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Successfully created port: 62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:04 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Instance spawned successfully.
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:04 user nova-compute[76442]: INFO nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Took 11.78 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:35:04 user nova-compute[76442]: INFO nova.compute.manager [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Took 12.78 seconds to build instance.
Nov 14 20:35:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3bf4a741-6012-4424-a93b-b09026ed9544 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.966s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:04 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:35:04 user nova-compute[76442]: INFO nova.compute.claims [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Claim successful on node user
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Successfully updated port: 62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "refresh_cache-15e2beda-544e-419b-b345-99f439670e0c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquired lock "refresh_cache-15e2beda-544e-419b-b345-99f439670e0c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:35:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:35:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Creating image(s)
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "/opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "/opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "/opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.policy [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05ec208e91594c36a30683258c9c687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd9ff5bbf1a49cca0d72a3ab4b34432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.216s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-fe89ba95-79f7-49db-abf9-1569ea33a15c req-5426d5a6-3ca4-4771-90f0-066e6e773a2d service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received event network-changed-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-fe89ba95-79f7-49db-abf9-1569ea33a15c req-5426d5a6-3ca4-4771-90f0-066e6e773a2d service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Refreshing instance network info cache due to event network-changed-62c9899e-37d0-44cd-b4c8-0b6edb19133c. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fe89ba95-79f7-49db-abf9-1569ea33a15c req-5426d5a6-3ca4-4771-90f0-066e6e773a2d service nova] Acquiring lock "refresh_cache-15e2beda-544e-419b-b345-99f439670e0c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.225s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk 1073741824" returned: 0 in 0.059s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.257s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:35:06 user nova-compute[76442]: INFO nova.compute.claims [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Claim successful on node user
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Cannot resize image /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Ensure instance console log exists: /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.network.neutron [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Updating instance_info_cache with network_info: [{"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Releasing lock "refresh_cache-15e2beda-544e-419b-b345-99f439670e0c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Instance network_info: |[{"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fe89ba95-79f7-49db-abf9-1569ea33a15c req-5426d5a6-3ca4-4771-90f0-066e6e773a2d service nova] Acquired lock "refresh_cache-15e2beda-544e-419b-b345-99f439670e0c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.network.neutron [req-fe89ba95-79f7-49db-abf9-1569ea33a15c req-5426d5a6-3ca4-4771-90f0-066e6e773a2d service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Refreshing network info cache for port 62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Start _get_guest_xml network_info=[{"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:35:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1074143063',display_name='tempest-DeleteServersTestJSON-server-1074143063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1074143063',id=2,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd8b97ba534f4544b0aa7d2fce1a97cc',ramdisk_id='',reservation_id='r-bloi8vtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-968047679',owner_user_name='tempest-DeleteServersTestJSON-968047679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:01Z,user_data=None,user_id='0b31c6c6a4eb4237a2ed349b300573b9',uuid=15e2beda-544e-419b-b345-99f439670e0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Converting VIF {"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d1:e2,bridge_name='br-int',has_traffic_filtering=True,id=62c9899e-37d0-44cd-b4c8-0b6edb19133c,network=Network(c7e653bb-fc43-46e1-9b67-d7fd3f1400f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c9899e-37') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lazy-loading 'pci_devices' on Instance uuid 15e2beda-544e-419b-b345-99f439670e0c {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:35:06 user nova-compute[76442]:   <uuid>15e2beda-544e-419b-b345-99f439670e0c</uuid>
Nov 14 20:35:06 user nova-compute[76442]:   <name>instance-00000002</name>
Nov 14 20:35:06 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:35:06 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:35:06 user nova-compute[76442]:   <metadata>
Nov 14 20:35:06 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:35:06 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:35:06 user nova-compute[76442]:       <nova:name>tempest-DeleteServersTestJSON-server-1074143063</nova:name>
Nov 14 20:35:06 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:35:06</nova:creationTime>
Nov 14 20:35:06 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:35:06 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:35:06 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:35:06 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:35:06 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:35:06 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:35:06 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:35:06 user nova-compute[76442]:       <nova:owner>
Nov 14 20:35:06 user nova-compute[76442]:         <nova:user uuid="0b31c6c6a4eb4237a2ed349b300573b9">tempest-DeleteServersTestJSON-968047679-project-member</nova:user>
Nov 14 20:35:06 user nova-compute[76442]:         <nova:project uuid="cd8b97ba534f4544b0aa7d2fce1a97cc">tempest-DeleteServersTestJSON-968047679</nova:project>
Nov 14 20:35:06 user nova-compute[76442]:       </nova:owner>
Nov 14 20:35:06 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:35:06 user nova-compute[76442]:       <nova:ports>
Nov 14 20:35:06 user nova-compute[76442]:         <nova:port uuid="62c9899e-37d0-44cd-b4c8-0b6edb19133c">
Nov 14 20:35:06 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 20:35:06 user nova-compute[76442]:         </nova:port>
Nov 14 20:35:06 user nova-compute[76442]:       </nova:ports>
Nov 14 20:35:06 user nova-compute[76442]:     </nova:instance>
Nov 14 20:35:06 user nova-compute[76442]:   </metadata>
Nov 14 20:35:06 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:35:06 user nova-compute[76442]:     <system>
Nov 14 20:35:06 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:35:06 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:35:06 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:35:06 user nova-compute[76442]:       <entry name="serial">15e2beda-544e-419b-b345-99f439670e0c</entry>
Nov 14 20:35:06 user nova-compute[76442]:       <entry name="uuid">15e2beda-544e-419b-b345-99f439670e0c</entry>
Nov 14 20:35:06 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:35:06 user nova-compute[76442]:     </system>
Nov 14 20:35:06 user nova-compute[76442]:   </sysinfo>
Nov 14 20:35:06 user nova-compute[76442]:   <os>
Nov 14 20:35:06 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:35:06 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:35:06 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:35:06 user nova-compute[76442]:   </os>
Nov 14 20:35:06 user nova-compute[76442]:   <features>
Nov 14 20:35:06 user nova-compute[76442]:     <acpi/>
Nov 14 20:35:06 user nova-compute[76442]:     <apic/>
Nov 14 20:35:06 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:35:06 user nova-compute[76442]:   </features>
Nov 14 20:35:06 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:35:06 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:35:06 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:35:06 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:35:06 user nova-compute[76442]:   </clock>
Nov 14 20:35:06 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:35:06 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:35:06 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:35:06 user nova-compute[76442]:   </cpu>
Nov 14 20:35:06 user nova-compute[76442]:   <devices>
Nov 14 20:35:06 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:35:06 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:35:06 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk"/>
Nov 14 20:35:06 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:35:06 user nova-compute[76442]:     </disk>
Nov 14 20:35:06 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:35:06 user nova-compute[76442]:       <mac address="fa:16:3e:c4:d1:e2"/>
Nov 14 20:35:06 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:06 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:35:06 user nova-compute[76442]:       <target dev="tap62c9899e-37"/>
Nov 14 20:35:06 user nova-compute[76442]:     </interface>
Nov 14 20:35:06 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:35:06 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/console.log" append="off"/>
Nov 14 20:35:06 user nova-compute[76442]:     </serial>
Nov 14 20:35:06 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:35:06 user nova-compute[76442]:     <video>
Nov 14 20:35:06 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:06 user nova-compute[76442]:     </video>
Nov 14 20:35:06 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:35:06 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:35:06 user nova-compute[76442]:     </rng>
Nov 14 20:35:06 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:35:06 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:35:06 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:35:06 user nova-compute[76442]:     </memballoon>
Nov 14 20:35:06 user nova-compute[76442]:   </devices>
Nov 14 20:35:06 user nova-compute[76442]: </domain>
Nov 14 20:35:06 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1074143063',display_name='tempest-DeleteServersTestJSON-server-1074143063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1074143063',id=2,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd8b97ba534f4544b0aa7d2fce1a97cc',ramdisk_id='',reservation_id='r-bloi8vtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-968047679',owner_user_name='tempest-DeleteServersTestJSON-968047679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:01Z,user_data=None,user_id='0b31c6c6a4eb4237a2ed349b300573b9',uuid=15e2beda-544e-419b-b345-99f439670e0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Converting VIF {"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d1:e2,bridge_name='br-int',has_traffic_filtering=True,id=62c9899e-37d0-44cd-b4c8-0b6edb19133c,network=Network(c7e653bb-fc43-46e1-9b67-d7fd3f1400f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c9899e-37') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG os_vif [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d1:e2,bridge_name='br-int',has_traffic_filtering=True,id=62c9899e-37d0-44cd-b4c8-0b6edb19133c,network=Network(c7e653bb-fc43-46e1-9b67-d7fd3f1400f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c9899e-37') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37e1f822-ee8d-5ac0-911d-976d4e8d8c58', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62c9899e-37, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62c9899e-37, col_values=(('qos', UUID('8d68f6a5-3cc1-434f-8240-e70b81bd8971')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62c9899e-37, col_values=(('external_ids', {'iface-id': '62c9899e-37d0-44cd-b4c8-0b6edb19133c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:d1:e2', 'vm-uuid': '15e2beda-544e-419b-b345-99f439670e0c'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:06 user nova-compute[76442]: INFO os_vif [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d1:e2,bridge_name='br-int',has_traffic_filtering=True,id=62c9899e-37d0-44cd-b4c8-0b6edb19133c,network=Network(c7e653bb-fc43-46e1-9b67-d7fd3f1400f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c9899e-37')
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.307s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:35:06 user nova-compute[76442]: INFO nova.compute.claims [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Claim successful on node user
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] No VIF found with MAC fa:16:3e:c4:d1:e2, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.network.neutron [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:35:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:35:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:35:07 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Creating image(s)
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "/opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "/opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.network.neutron [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Successfully created port: 9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.policy [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1451459113e244e798fff66799c10c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e7d9ec7d5342a797576c7e568c1073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.211s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:35:07 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.258s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:35:07 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Creating image(s)
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk 1073741824" returned: 0 in 0.079s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.222s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:35:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.policy [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1af6b467fdcf4757ada855e3d83d11d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1263fe84fb4684a1a09ca104614513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.network.neutron [req-fe89ba95-79f7-49db-abf9-1569ea33a15c req-5426d5a6-3ca4-4771-90f0-066e6e773a2d service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Updated VIF entry in instance network info cache for port 62c9899e-37d0-44cd-b4c8-0b6edb19133c. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.network.neutron [req-fe89ba95-79f7-49db-abf9-1569ea33a15c req-5426d5a6-3ca4-4771-90f0-066e6e773a2d service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Updating instance_info_cache with network_info: [{"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.220s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fe89ba95-79f7-49db-abf9-1569ea33a15c req-5426d5a6-3ca4-4771-90f0-066e6e773a2d service nova] Releasing lock "refresh_cache-15e2beda-544e-419b-b345-99f439670e0c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Cannot resize image /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Ensure instance console log exists: /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk 1073741824" returned: 0 in 0.062s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.258s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Cannot resize image /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Ensure instance console log exists: /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Successfully updated port: 9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Successfully created port: c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquired lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-108e6a58-f683-4d7e-b161-81f12a0b7365 req-fa1125e0-d176-4a82-a2d2-ad0dbb871f5e service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received event network-changed-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-108e6a58-f683-4d7e-b161-81f12a0b7365 req-fa1125e0-d176-4a82-a2d2-ad0dbb871f5e service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Refreshing instance network info cache due to event network-changed-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:35:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-108e6a58-f683-4d7e-b161-81f12a0b7365 req-fa1125e0-d176-4a82-a2d2-ad0dbb871f5e service nova] Acquiring lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.network.neutron [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.network.neutron [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Successfully created port: efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:10 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Instance spawned successfully.
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:10 user nova-compute[76442]: INFO nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Took 9.70 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:10 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:10 user nova-compute[76442]: INFO nova.compute.manager [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Took 10.66 seconds to build instance.
Nov 14 20:35:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2ef7c2a6-7586-4c0c-b6b4-b7a8aed4a761 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.828s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.network.neutron [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Updating instance_info_cache with network_info: [{"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Releasing lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Instance network_info: |[{"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-108e6a58-f683-4d7e-b161-81f12a0b7365 req-fa1125e0-d176-4a82-a2d2-ad0dbb871f5e service nova] Acquired lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.network.neutron [req-108e6a58-f683-4d7e-b161-81f12a0b7365 req-fa1125e0-d176-4a82-a2d2-ad0dbb871f5e service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Refreshing network info cache for port 9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Start _get_guest_xml network_info=[{"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:35:11 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:11 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1672825965',display_name='tempest-AttachVolumeNegativeTest-server-1672825965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1672825965',id=3,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwwqcyICyRAN6CXNbGQ9iWnzA5ha8Vk9Xh/gBJpISnDSLZ3e3UCyLQavfYVow6BiCcdVFCaHNBGj39koRaWmmtBFZfVqIZezY4cDJt/rP+eOoNcChp42UhE9Qt7knKrmA==',key_name='tempest-keypair-1076036811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-pmywfhxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=da018992-79f4-4db3-bbf7-a492508ff629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:e1:6e,bridge_name='br-int',has_traffic_filtering=True,id=9257e17c-00d0-4a97-ace5-2d7ce1ba60c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9257e17c-00') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.objects.instance [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'pci_devices' on Instance uuid da018992-79f4-4db3-bbf7-a492508ff629 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:35:11 user nova-compute[76442]:   <uuid>da018992-79f4-4db3-bbf7-a492508ff629</uuid>
Nov 14 20:35:11 user nova-compute[76442]:   <name>instance-00000003</name>
Nov 14 20:35:11 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:35:11 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:35:11 user nova-compute[76442]:   <metadata>
Nov 14 20:35:11 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:35:11 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:35:11 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1672825965</nova:name>
Nov 14 20:35:11 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:35:11</nova:creationTime>
Nov 14 20:35:11 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:35:11 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:35:11 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:35:11 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:35:11 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:35:11 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:35:11 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:35:11 user nova-compute[76442]:       <nova:owner>
Nov 14 20:35:11 user nova-compute[76442]:         <nova:user uuid="05ec208e91594c36a30683258c9c687d">tempest-AttachVolumeNegativeTest-1957433764-project-member</nova:user>
Nov 14 20:35:11 user nova-compute[76442]:         <nova:project uuid="5bd9ff5bbf1a49cca0d72a3ab4b34432">tempest-AttachVolumeNegativeTest-1957433764</nova:project>
Nov 14 20:35:11 user nova-compute[76442]:       </nova:owner>
Nov 14 20:35:11 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:35:11 user nova-compute[76442]:       <nova:ports>
Nov 14 20:35:11 user nova-compute[76442]:         <nova:port uuid="9257e17c-00d0-4a97-ace5-2d7ce1ba60c4">
Nov 14 20:35:11 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 20:35:11 user nova-compute[76442]:         </nova:port>
Nov 14 20:35:11 user nova-compute[76442]:       </nova:ports>
Nov 14 20:35:11 user nova-compute[76442]:     </nova:instance>
Nov 14 20:35:11 user nova-compute[76442]:   </metadata>
Nov 14 20:35:11 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:35:11 user nova-compute[76442]:     <system>
Nov 14 20:35:11 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:35:11 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:35:11 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:35:11 user nova-compute[76442]:       <entry name="serial">da018992-79f4-4db3-bbf7-a492508ff629</entry>
Nov 14 20:35:11 user nova-compute[76442]:       <entry name="uuid">da018992-79f4-4db3-bbf7-a492508ff629</entry>
Nov 14 20:35:11 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:35:11 user nova-compute[76442]:     </system>
Nov 14 20:35:11 user nova-compute[76442]:   </sysinfo>
Nov 14 20:35:11 user nova-compute[76442]:   <os>
Nov 14 20:35:11 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:35:11 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:35:11 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:35:11 user nova-compute[76442]:   </os>
Nov 14 20:35:11 user nova-compute[76442]:   <features>
Nov 14 20:35:11 user nova-compute[76442]:     <acpi/>
Nov 14 20:35:11 user nova-compute[76442]:     <apic/>
Nov 14 20:35:11 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:35:11 user nova-compute[76442]:   </features>
Nov 14 20:35:11 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:35:11 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:35:11 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:35:11 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:35:11 user nova-compute[76442]:   </clock>
Nov 14 20:35:11 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:35:11 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:35:11 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:35:11 user nova-compute[76442]:   </cpu>
Nov 14 20:35:11 user nova-compute[76442]:   <devices>
Nov 14 20:35:11 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:35:11 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:35:11 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk"/>
Nov 14 20:35:11 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:35:11 user nova-compute[76442]:     </disk>
Nov 14 20:35:11 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:35:11 user nova-compute[76442]:       <mac address="fa:16:3e:af:e1:6e"/>
Nov 14 20:35:11 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:11 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:35:11 user nova-compute[76442]:       <target dev="tap9257e17c-00"/>
Nov 14 20:35:11 user nova-compute[76442]:     </interface>
Nov 14 20:35:11 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:35:11 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/console.log" append="off"/>
Nov 14 20:35:11 user nova-compute[76442]:     </serial>
Nov 14 20:35:11 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:35:11 user nova-compute[76442]:     <video>
Nov 14 20:35:11 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:11 user nova-compute[76442]:     </video>
Nov 14 20:35:11 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:35:11 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:35:11 user nova-compute[76442]:     </rng>
Nov 14 20:35:11 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:35:11 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:35:11 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:35:11 user nova-compute[76442]:     </memballoon>
Nov 14 20:35:11 user nova-compute[76442]:   </devices>
Nov 14 20:35:11 user nova-compute[76442]: </domain>
Nov 14 20:35:11 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1672825965',display_name='tempest-AttachVolumeNegativeTest-server-1672825965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1672825965',id=3,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwwqcyICyRAN6CXNbGQ9iWnzA5ha8Vk9Xh/gBJpISnDSLZ3e3UCyLQavfYVow6BiCcdVFCaHNBGj39koRaWmmtBFZfVqIZezY4cDJt/rP+eOoNcChp42UhE9Qt7knKrmA==',key_name='tempest-keypair-1076036811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-pmywfhxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=da018992-79f4-4db3-bbf7-a492508ff629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:e1:6e,bridge_name='br-int',has_traffic_filtering=True,id=9257e17c-00d0-4a97-ace5-2d7ce1ba60c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9257e17c-00') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG os_vif [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:e1:6e,bridge_name='br-int',has_traffic_filtering=True,id=9257e17c-00d0-4a97-ace5-2d7ce1ba60c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9257e17c-00') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e6f28b6-8b63-5f5c-9e0e-801a30bba0d6', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9257e17c-00, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9257e17c-00, col_values=(('qos', UUID('ed3c5d4e-4d64-491b-bbc4-e7122e46336a')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9257e17c-00, col_values=(('external_ids', {'iface-id': '9257e17c-00d0-4a97-ace5-2d7ce1ba60c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:e1:6e', 'vm-uuid': 'da018992-79f4-4db3-bbf7-a492508ff629'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:11 user nova-compute[76442]: INFO os_vif [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:e1:6e,bridge_name='br-int',has_traffic_filtering=True,id=9257e17c-00d0-4a97-ace5-2d7ce1ba60c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9257e17c-00')
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No VIF found with MAC fa:16:3e:af:e1:6e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG nova.network.neutron [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Successfully updated port: efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquired lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG nova.network.neutron [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG nova.network.neutron [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG nova.network.neutron [req-108e6a58-f683-4d7e-b161-81f12a0b7365 req-fa1125e0-d176-4a82-a2d2-ad0dbb871f5e service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Updated VIF entry in instance network info cache for port 9257e17c-00d0-4a97-ace5-2d7ce1ba60c4. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG nova.network.neutron [req-108e6a58-f683-4d7e-b161-81f12a0b7365 req-fa1125e0-d176-4a82-a2d2-ad0dbb871f5e service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Updating instance_info_cache with network_info: [{"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-108e6a58-f683-4d7e-b161-81f12a0b7365 req-fa1125e0-d176-4a82-a2d2-ad0dbb871f5e service nova] Releasing lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-32c50401-f625-4b76-a184-3feff65a32f4 req-557b00ef-6b49-4830-8bc2-bdc83c85bac6 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-changed-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-32c50401-f625-4b76-a184-3feff65a32f4 req-557b00ef-6b49-4830-8bc2-bdc83c85bac6 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Refreshing instance network info cache due to event network-changed-efe55142-461c-40ce-a422-d396af94b09d. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:35:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-32c50401-f625-4b76-a184-3feff65a32f4 req-557b00ef-6b49-4830-8bc2-bdc83c85bac6 service nova] Acquiring lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Successfully updated port: c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquired lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-c43d9966-7f1a-4911-919d-2cbd803e54e4 req-ce9088d7-3e9f-4efc-9e78-201fe72c750f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-changed-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-c43d9966-7f1a-4911-919d-2cbd803e54e4 req-ce9088d7-3e9f-4efc-9e78-201fe72c750f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Refreshing instance network info cache due to event network-changed-c58581ff-741a-45f7-a75f-11a6a5ee71ce. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c43d9966-7f1a-4911-919d-2cbd803e54e4 req-ce9088d7-3e9f-4efc-9e78-201fe72c750f service nova] Acquiring lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating instance_info_cache with network_info: [{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Releasing lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance network_info: |[{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-32c50401-f625-4b76-a184-3feff65a32f4 req-557b00ef-6b49-4830-8bc2-bdc83c85bac6 service nova] Acquired lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-32c50401-f625-4b76-a184-3feff65a32f4 req-557b00ef-6b49-4830-8bc2-bdc83c85bac6 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Refreshing network info cache for port efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Start _get_guest_xml network_info=[{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:35:13 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:13 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878133652',display_name='tempest-AttachVolumeTestJSON-server-878133652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878133652',id=4,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDheVhyXKd1tLetq6drOD0c1HXCNMGuyk4trFFV+OHU/w0jSDxWd/s0s9dAgCq1IdTQzrf7GK4Rv/3WoY7/OLU1yzzvADVAojoOIUFiIYeEUqj31jXAcxcBX+C/r+XI6AQ==',key_name='tempest-keypair-857353389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-nein8fe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=d7c90b52-307d-4a1d-98ab-68449f84c3f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'pci_devices' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:35:13 user nova-compute[76442]:   <uuid>d7c90b52-307d-4a1d-98ab-68449f84c3f2</uuid>
Nov 14 20:35:13 user nova-compute[76442]:   <name>instance-00000004</name>
Nov 14 20:35:13 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:35:13 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:35:13 user nova-compute[76442]:   <metadata>
Nov 14 20:35:13 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:35:13 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:35:13 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeTestJSON-server-878133652</nova:name>
Nov 14 20:35:13 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:35:13</nova:creationTime>
Nov 14 20:35:13 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:35:13 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:35:13 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:35:13 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:35:13 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:35:13 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:35:13 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:35:13 user nova-compute[76442]:       <nova:owner>
Nov 14 20:35:13 user nova-compute[76442]:         <nova:user uuid="1451459113e244e798fff66799c10c48">tempest-AttachVolumeTestJSON-650801364-project-member</nova:user>
Nov 14 20:35:13 user nova-compute[76442]:         <nova:project uuid="b1e7d9ec7d5342a797576c7e568c1073">tempest-AttachVolumeTestJSON-650801364</nova:project>
Nov 14 20:35:13 user nova-compute[76442]:       </nova:owner>
Nov 14 20:35:13 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:35:13 user nova-compute[76442]:       <nova:ports>
Nov 14 20:35:13 user nova-compute[76442]:         <nova:port uuid="efe55142-461c-40ce-a422-d396af94b09d">
Nov 14 20:35:13 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 20:35:13 user nova-compute[76442]:         </nova:port>
Nov 14 20:35:13 user nova-compute[76442]:       </nova:ports>
Nov 14 20:35:13 user nova-compute[76442]:     </nova:instance>
Nov 14 20:35:13 user nova-compute[76442]:   </metadata>
Nov 14 20:35:13 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:35:13 user nova-compute[76442]:     <system>
Nov 14 20:35:13 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:35:13 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:35:13 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:35:13 user nova-compute[76442]:       <entry name="serial">d7c90b52-307d-4a1d-98ab-68449f84c3f2</entry>
Nov 14 20:35:13 user nova-compute[76442]:       <entry name="uuid">d7c90b52-307d-4a1d-98ab-68449f84c3f2</entry>
Nov 14 20:35:13 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:35:13 user nova-compute[76442]:     </system>
Nov 14 20:35:13 user nova-compute[76442]:   </sysinfo>
Nov 14 20:35:13 user nova-compute[76442]:   <os>
Nov 14 20:35:13 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:35:13 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:35:13 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:35:13 user nova-compute[76442]:   </os>
Nov 14 20:35:13 user nova-compute[76442]:   <features>
Nov 14 20:35:13 user nova-compute[76442]:     <acpi/>
Nov 14 20:35:13 user nova-compute[76442]:     <apic/>
Nov 14 20:35:13 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:35:13 user nova-compute[76442]:   </features>
Nov 14 20:35:13 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:35:13 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:35:13 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:35:13 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:35:13 user nova-compute[76442]:   </clock>
Nov 14 20:35:13 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:35:13 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:35:13 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:35:13 user nova-compute[76442]:   </cpu>
Nov 14 20:35:13 user nova-compute[76442]:   <devices>
Nov 14 20:35:13 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:35:13 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:35:13 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk"/>
Nov 14 20:35:13 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:35:13 user nova-compute[76442]:     </disk>
Nov 14 20:35:13 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:35:13 user nova-compute[76442]:       <mac address="fa:16:3e:d2:0d:f0"/>
Nov 14 20:35:13 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:13 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:35:13 user nova-compute[76442]:       <target dev="tapefe55142-46"/>
Nov 14 20:35:13 user nova-compute[76442]:     </interface>
Nov 14 20:35:13 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:35:13 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/console.log" append="off"/>
Nov 14 20:35:13 user nova-compute[76442]:     </serial>
Nov 14 20:35:13 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:35:13 user nova-compute[76442]:     <video>
Nov 14 20:35:13 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:13 user nova-compute[76442]:     </video>
Nov 14 20:35:13 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:35:13 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:35:13 user nova-compute[76442]:     </rng>
Nov 14 20:35:13 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:35:13 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:35:13 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:35:13 user nova-compute[76442]:     </memballoon>
Nov 14 20:35:13 user nova-compute[76442]:   </devices>
Nov 14 20:35:13 user nova-compute[76442]: </domain>
Nov 14 20:35:13 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878133652',display_name='tempest-AttachVolumeTestJSON-server-878133652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878133652',id=4,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDheVhyXKd1tLetq6drOD0c1HXCNMGuyk4trFFV+OHU/w0jSDxWd/s0s9dAgCq1IdTQzrf7GK4Rv/3WoY7/OLU1yzzvADVAojoOIUFiIYeEUqj31jXAcxcBX+C/r+XI6AQ==',key_name='tempest-keypair-857353389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-nein8fe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=d7c90b52-307d-4a1d-98ab-68449f84c3f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG os_vif [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41af6940-7304-5c25-9ae4-97b019a2a897', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefe55142-46, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefe55142-46, col_values=(('qos', UUID('20435293-293f-4925-9dba-a1209f6555e1')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefe55142-46, col_values=(('external_ids', {'iface-id': 'efe55142-461c-40ce-a422-d396af94b09d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:0d:f0', 'vm-uuid': 'd7c90b52-307d-4a1d-98ab-68449f84c3f2'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: INFO os_vif [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46')
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No VIF found with MAC fa:16:3e:d2:0d:f0, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating instance_info_cache with network_info: [{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Releasing lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Instance network_info: |[{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c43d9966-7f1a-4911-919d-2cbd803e54e4 req-ce9088d7-3e9f-4efc-9e78-201fe72c750f service nova] Acquired lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.network.neutron [req-c43d9966-7f1a-4911-919d-2cbd803e54e4 req-ce9088d7-3e9f-4efc-9e78-201fe72c750f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Refreshing network info cache for port c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Start _get_guest_xml network_info=[{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:35:14 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:14 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-335839947',display_name='tempest-ServerStableDeviceRescueTest-server-335839947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-335839947',id=5,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/XqWsEw0A7lQIR+/+6ZeguQtqwARyySz2E7GtGl2FNgl2f+Q/zJQXKVM2Al5vTWFFKeACaFh/bkGhYeTapvX8ssprXr8Ndv/dc89RmirS6tmlKpy+FydEjDL+sf6jb7w==',key_name='tempest-keypair-1389631806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec1263fe84fb4684a1a09ca104614513',ramdisk_id='',reservation_id='r-69vsu0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1286396350',owner_user_name='tempest-ServerStableDeviceRescueTest-1286396350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1af6b467fdcf4757ada855e3d83d11d2',uuid=3f966f64-95e9-4de8-8464-a7ed018b8db6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Converting VIF {"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ac:ad,bridge_name='br-int',has_traffic_filtering=True,id=c58581ff-741a-45f7-a75f-11a6a5ee71ce,network=Network(dec26ce6-a4d7-44f8-802a-476a75ece865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58581ff-74') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.network.neutron [req-32c50401-f625-4b76-a184-3feff65a32f4 req-557b00ef-6b49-4830-8bc2-bdc83c85bac6 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updated VIF entry in instance network info cache for port efe55142-461c-40ce-a422-d396af94b09d. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.network.neutron [req-32c50401-f625-4b76-a184-3feff65a32f4 req-557b00ef-6b49-4830-8bc2-bdc83c85bac6 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating instance_info_cache with network_info: [{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:35:14 user nova-compute[76442]:   <uuid>3f966f64-95e9-4de8-8464-a7ed018b8db6</uuid>
Nov 14 20:35:14 user nova-compute[76442]:   <name>instance-00000005</name>
Nov 14 20:35:14 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:35:14 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:35:14 user nova-compute[76442]:   <metadata>
Nov 14 20:35:14 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:35:14 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:35:14 user nova-compute[76442]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-335839947</nova:name>
Nov 14 20:35:14 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:35:14</nova:creationTime>
Nov 14 20:35:14 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:35:14 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:35:14 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:35:14 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:35:14 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:35:14 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:35:14 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:35:14 user nova-compute[76442]:       <nova:owner>
Nov 14 20:35:14 user nova-compute[76442]:         <nova:user uuid="1af6b467fdcf4757ada855e3d83d11d2">tempest-ServerStableDeviceRescueTest-1286396350-project-member</nova:user>
Nov 14 20:35:14 user nova-compute[76442]:         <nova:project uuid="ec1263fe84fb4684a1a09ca104614513">tempest-ServerStableDeviceRescueTest-1286396350</nova:project>
Nov 14 20:35:14 user nova-compute[76442]:       </nova:owner>
Nov 14 20:35:14 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:35:14 user nova-compute[76442]:       <nova:ports>
Nov 14 20:35:14 user nova-compute[76442]:         <nova:port uuid="c58581ff-741a-45f7-a75f-11a6a5ee71ce">
Nov 14 20:35:14 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 20:35:14 user nova-compute[76442]:         </nova:port>
Nov 14 20:35:14 user nova-compute[76442]:       </nova:ports>
Nov 14 20:35:14 user nova-compute[76442]:     </nova:instance>
Nov 14 20:35:14 user nova-compute[76442]:   </metadata>
Nov 14 20:35:14 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:35:14 user nova-compute[76442]:     <system>
Nov 14 20:35:14 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:35:14 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:35:14 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:35:14 user nova-compute[76442]:       <entry name="serial">3f966f64-95e9-4de8-8464-a7ed018b8db6</entry>
Nov 14 20:35:14 user nova-compute[76442]:       <entry name="uuid">3f966f64-95e9-4de8-8464-a7ed018b8db6</entry>
Nov 14 20:35:14 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:35:14 user nova-compute[76442]:     </system>
Nov 14 20:35:14 user nova-compute[76442]:   </sysinfo>
Nov 14 20:35:14 user nova-compute[76442]:   <os>
Nov 14 20:35:14 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:35:14 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:35:14 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:35:14 user nova-compute[76442]:   </os>
Nov 14 20:35:14 user nova-compute[76442]:   <features>
Nov 14 20:35:14 user nova-compute[76442]:     <acpi/>
Nov 14 20:35:14 user nova-compute[76442]:     <apic/>
Nov 14 20:35:14 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:35:14 user nova-compute[76442]:   </features>
Nov 14 20:35:14 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:35:14 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:35:14 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:35:14 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:35:14 user nova-compute[76442]:   </clock>
Nov 14 20:35:14 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:35:14 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:35:14 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:35:14 user nova-compute[76442]:   </cpu>
Nov 14 20:35:14 user nova-compute[76442]:   <devices>
Nov 14 20:35:14 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:35:14 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:35:14 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk"/>
Nov 14 20:35:14 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:35:14 user nova-compute[76442]:     </disk>
Nov 14 20:35:14 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:35:14 user nova-compute[76442]:       <mac address="fa:16:3e:8d:ac:ad"/>
Nov 14 20:35:14 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:14 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:35:14 user nova-compute[76442]:       <target dev="tapc58581ff-74"/>
Nov 14 20:35:14 user nova-compute[76442]:     </interface>
Nov 14 20:35:14 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:35:14 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/console.log" append="off"/>
Nov 14 20:35:14 user nova-compute[76442]:     </serial>
Nov 14 20:35:14 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:35:14 user nova-compute[76442]:     <video>
Nov 14 20:35:14 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:14 user nova-compute[76442]:     </video>
Nov 14 20:35:14 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:35:14 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:35:14 user nova-compute[76442]:     </rng>
Nov 14 20:35:14 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:35:14 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:35:14 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:35:14 user nova-compute[76442]:     </memballoon>
Nov 14 20:35:14 user nova-compute[76442]:   </devices>
Nov 14 20:35:14 user nova-compute[76442]: </domain>
Nov 14 20:35:14 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-335839947',display_name='tempest-ServerStableDeviceRescueTest-server-335839947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-335839947',id=5,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/XqWsEw0A7lQIR+/+6ZeguQtqwARyySz2E7GtGl2FNgl2f+Q/zJQXKVM2Al5vTWFFKeACaFh/bkGhYeTapvX8ssprXr8Ndv/dc89RmirS6tmlKpy+FydEjDL+sf6jb7w==',key_name='tempest-keypair-1389631806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec1263fe84fb4684a1a09ca104614513',ramdisk_id='',reservation_id='r-69vsu0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1286396350',owner_user_name='tempest-ServerStableDeviceRescueTest-1286396350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1af6b467fdcf4757ada855e3d83d11d2',uuid=3f966f64-95e9-4de8-8464-a7ed018b8db6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Converting VIF {"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ac:ad,bridge_name='br-int',has_traffic_filtering=True,id=c58581ff-741a-45f7-a75f-11a6a5ee71ce,network=Network(dec26ce6-a4d7-44f8-802a-476a75ece865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58581ff-74') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG os_vif [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ac:ad,bridge_name='br-int',has_traffic_filtering=True,id=c58581ff-741a-45f7-a75f-11a6a5ee71ce,network=Network(dec26ce6-a4d7-44f8-802a-476a75ece865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58581ff-74') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8876bb7a-e96e-5b84-81b1-5d30902afa21', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-32c50401-f625-4b76-a184-3feff65a32f4 req-557b00ef-6b49-4830-8bc2-bdc83c85bac6 service nova] Releasing lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc58581ff-74, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc58581ff-74, col_values=(('qos', UUID('924910a8-f6e8-4fe2-8509-41eacc721fd7')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc58581ff-74, col_values=(('external_ids', {'iface-id': 'c58581ff-741a-45f7-a75f-11a6a5ee71ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:ac:ad', 'vm-uuid': '3f966f64-95e9-4de8-8464-a7ed018b8db6'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:14 user nova-compute[76442]: INFO os_vif [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ac:ad,bridge_name='br-int',has_traffic_filtering=True,id=c58581ff-741a-45f7-a75f-11a6a5ee71ce,network=Network(dec26ce6-a4d7-44f8-802a-476a75ece865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58581ff-74')
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] No VIF found with MAC fa:16:3e:8d:ac:ad, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Instance spawned successfully.
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:15 user nova-compute[76442]: INFO nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Took 10.45 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:16 user nova-compute[76442]: INFO nova.compute.manager [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Took 11.19 seconds to build instance.
Nov 14 20:35:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-c3a99b2d-fdcb-4944-bf1a-3b00e4ed8443 req-59954fcb-7089-430e-8c8a-ae1a64680ac8 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c3a99b2d-fdcb-4944-bf1a-3b00e4ed8443 req-59954fcb-7089-430e-8c8a-ae1a64680ac8 service nova] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c3a99b2d-fdcb-4944-bf1a-3b00e4ed8443 req-59954fcb-7089-430e-8c8a-ae1a64680ac8 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c3a99b2d-fdcb-4944-bf1a-3b00e4ed8443 req-59954fcb-7089-430e-8c8a-ae1a64680ac8 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-c3a99b2d-fdcb-4944-bf1a-3b00e4ed8443 req-59954fcb-7089-430e-8c8a-ae1a64680ac8 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] No waiting events found dispatching network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:16 user nova-compute[76442]: WARNING nova.compute.manager [req-c3a99b2d-fdcb-4944-bf1a-3b00e4ed8443 req-59954fcb-7089-430e-8c8a-ae1a64680ac8 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received unexpected event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 for instance with vm_state active and task_state None.
Nov 14 20:35:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-09ef9345-eefb-43c0-9346-b2f4d6bd1d5d tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.381s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:17 user nova-compute[76442]: DEBUG nova.network.neutron [req-c43d9966-7f1a-4911-919d-2cbd803e54e4 req-ce9088d7-3e9f-4efc-9e78-201fe72c750f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updated VIF entry in instance network info cache for port c58581ff-741a-45f7-a75f-11a6a5ee71ce. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:17 user nova-compute[76442]: DEBUG nova.network.neutron [req-c43d9966-7f1a-4911-919d-2cbd803e54e4 req-ce9088d7-3e9f-4efc-9e78-201fe72c750f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating instance_info_cache with network_info: [{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c43d9966-7f1a-4911-919d-2cbd803e54e4 req-ce9088d7-3e9f-4efc-9e78-201fe72c750f service nova] Releasing lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-2a5b7a7f-2bb9-48c5-b35d-d0cccd9eceae req-86090f9c-b11e-4add-a12f-0dfde0581718 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2a5b7a7f-2bb9-48c5-b35d-d0cccd9eceae req-86090f9c-b11e-4add-a12f-0dfde0581718 service nova] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2a5b7a7f-2bb9-48c5-b35d-d0cccd9eceae req-86090f9c-b11e-4add-a12f-0dfde0581718 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2a5b7a7f-2bb9-48c5-b35d-d0cccd9eceae req-86090f9c-b11e-4add-a12f-0dfde0581718 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-2a5b7a7f-2bb9-48c5-b35d-d0cccd9eceae req-86090f9c-b11e-4add-a12f-0dfde0581718 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] No waiting events found dispatching network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:18 user nova-compute[76442]: WARNING nova.compute.manager [req-2a5b7a7f-2bb9-48c5-b35d-d0cccd9eceae req-86090f9c-b11e-4add-a12f-0dfde0581718 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received unexpected event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 for instance with vm_state active and task_state None.
Nov 14 20:35:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:20 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance spawned successfully.
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:20 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Instance spawned successfully.
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:20 user nova-compute[76442]: INFO nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Took 13.11 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:20 user nova-compute[76442]: INFO nova.compute.manager [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Took 14.21 seconds to build instance.
Nov 14 20:35:20 user nova-compute[76442]: INFO nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Took 12.75 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7a61b598-4d13-4b2c-9eec-4e09232df0a1 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.359s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:20 user nova-compute[76442]: INFO nova.compute.manager [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Took 14.11 seconds to build instance.
Nov 14 20:35:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e0a8d2d4-cb44-4196-bb5b-9514fd241eee tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.328s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:35:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:35:23 user nova-compute[76442]: INFO nova.compute.claims [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Claim successful on node user
Nov 14 20:35:23 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:35:23 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:35:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:35:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:35:24 user nova-compute[76442]: DEBUG nova.network.neutron [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:35:24 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:35:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:35:24 user nova-compute[76442]: DEBUG nova.policy [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a9c7939d95a4ec1b47672c31de2330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f754011c54964adcb6898beac89668e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:35:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:35:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:35:24 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Creating image(s)
Nov 14 20:35:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "/opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "/opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "/opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.122s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.346s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.302s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk 1073741824" returned: 0 in 0.096s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.409s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.291s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Cannot resize image /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Ensure instance console log exists: /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:35:26 user nova-compute[76442]: INFO nova.compute.claims [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Claim successful on node user
Nov 14 20:35:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Successfully created port: 0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.747s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:35:27 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 20:35:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-3b6fa2a2-8386-4e70-bf9c-e9ebe27f9554 req-83aa8033-e50a-49cb-8408-130abe094418 service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3b6fa2a2-8386-4e70-bf9c-e9ebe27f9554 req-83aa8033-e50a-49cb-8408-130abe094418 service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3b6fa2a2-8386-4e70-bf9c-e9ebe27f9554 req-83aa8033-e50a-49cb-8408-130abe094418 service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3b6fa2a2-8386-4e70-bf9c-e9ebe27f9554 req-83aa8033-e50a-49cb-8408-130abe094418 service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-3b6fa2a2-8386-4e70-bf9c-e9ebe27f9554 req-83aa8033-e50a-49cb-8408-130abe094418 service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:27 user nova-compute[76442]: WARNING nova.compute.manager [req-3b6fa2a2-8386-4e70-bf9c-e9ebe27f9554 req-83aa8033-e50a-49cb-8408-130abe094418 service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state active and task_state None.
Nov 14 20:35:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:35:27 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Creating image(s)
Nov 14 20:35:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "/opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "/opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "/opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "957a671ff535b421fc0857dae43576e9d6d3a987" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "957a671ff535b421fc0857dae43576e9d6d3a987" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:27 user nova-compute[76442]: DEBUG nova.policy [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '719ba1f189744fbda79093cdf7f4bbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dde59546f394a5a9da91dfbf0b887a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-4dcb1ee7-5a3c-45f9-8aed-5fcf6af79177 req-23201021-aad6-49ec-be70-08825cc720b6 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received event network-vif-plugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4dcb1ee7-5a3c-45f9-8aed-5fcf6af79177 req-23201021-aad6-49ec-be70-08825cc720b6 service nova] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4dcb1ee7-5a3c-45f9-8aed-5fcf6af79177 req-23201021-aad6-49ec-be70-08825cc720b6 service nova] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4dcb1ee7-5a3c-45f9-8aed-5fcf6af79177 req-23201021-aad6-49ec-be70-08825cc720b6 service nova] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-4dcb1ee7-5a3c-45f9-8aed-5fcf6af79177 req-23201021-aad6-49ec-be70-08825cc720b6 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] No waiting events found dispatching network-vif-plugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:28 user nova-compute[76442]: WARNING nova.compute.manager [req-4dcb1ee7-5a3c-45f9-8aed-5fcf6af79177 req-23201021-aad6-49ec-be70-08825cc720b6 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received unexpected event network-vif-plugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 for instance with vm_state active and task_state None.
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987.part --force-share --output=json" returned: 0 in 0.220s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG nova.virt.images [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] 464f0a50-254e-4c17-a79f-6f6ef3e7500d was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987.part /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG nova.network.neutron [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Successfully updated port: 0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "refresh_cache-24c3abec-1233-45d1-a5ce-d5a14f76b313" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquired lock "refresh_cache-24c3abec-1233-45d1-a5ce-d5a14f76b313" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG nova.network.neutron [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:35:28 user nova-compute[76442]: INFO nova.compute.claims [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Claim successful on node user
Nov 14 20:35:28 user nova-compute[76442]: DEBUG nova.network.neutron [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987.part /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987.converted" returned: 0 in 0.496s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987.converted --force-share --output=json" returned: 0 in 0.285s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "957a671ff535b421fc0857dae43576e9d6d3a987" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.717s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-04d9e613-e7ac-43c4-9337-8eff90046b3a req-590af307-b793-4a4f-a892-b45ce327f83f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-04d9e613-e7ac-43c4-9337-8eff90046b3a req-590af307-b793-4a4f-a892-b45ce327f83f service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-04d9e613-e7ac-43c4-9337-8eff90046b3a req-590af307-b793-4a4f-a892-b45ce327f83f service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-04d9e613-e7ac-43c4-9337-8eff90046b3a req-590af307-b793-4a4f-a892-b45ce327f83f service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-04d9e613-e7ac-43c4-9337-8eff90046b3a req-590af307-b793-4a4f-a892-b45ce327f83f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:29 user nova-compute[76442]: WARNING nova.compute.manager [req-04d9e613-e7ac-43c4-9337-8eff90046b3a req-590af307-b793-4a4f-a892-b45ce327f83f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state active and task_state None.
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987 --force-share --output=json" returned: 0 in 0.296s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "957a671ff535b421fc0857dae43576e9d6d3a987" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "957a671ff535b421fc0857dae43576e9d6d3a987" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.network.neutron [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Updating instance_info_cache with network_info: [{"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Releasing lock "refresh_cache-24c3abec-1233-45d1-a5ce-d5a14f76b313" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Instance network_info: |[{"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Start _get_guest_xml network_info=[{"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:35:29 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:29 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:29 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1197385494',display_name='tempest-VolumesAdminNegativeTest-server-1197385494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1197385494',id=6,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlQHpySRIAnXadiOnW4wVNWS/67tXiq06Y9Mb5qaH10uQ7UGVUIteSSLi7+eutxBekv/S+UNrYx3C8FXyBvBHms4e6VZ8rFq0VFHG7ZcfgVZIIboSf7Wra/p33BJbVC4Q==',key_name='tempest-keypair-2112243525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f754011c54964adcb6898beac89668e1',ramdisk_id='',reservation_id='r-a10fuxk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1803889283',owner_user_name='tempest-VolumesAdminNegativeTest-1803889283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a9c7939d95a4ec1b47672c31de2330a',uuid=24c3abec-1233-45d1-a5ce-d5a14f76b313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converting VIF {"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:16:af,bridge_name='br-int',has_traffic_filtering=True,id=0b7921ee-3266-4e01-996e-b9f62b1b589a,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7921ee-32') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.objects.instance [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lazy-loading 'pci_devices' on Instance uuid 24c3abec-1233-45d1-a5ce-d5a14f76b313 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:35:29 user nova-compute[76442]:   <uuid>24c3abec-1233-45d1-a5ce-d5a14f76b313</uuid>
Nov 14 20:35:29 user nova-compute[76442]:   <name>instance-00000006</name>
Nov 14 20:35:29 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:35:29 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:35:29 user nova-compute[76442]:   <metadata>
Nov 14 20:35:29 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:35:29 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:35:29 user nova-compute[76442]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1197385494</nova:name>
Nov 14 20:35:29 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:35:29</nova:creationTime>
Nov 14 20:35:29 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:35:29 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:35:29 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:35:29 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:35:29 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:35:29 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:35:29 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:35:29 user nova-compute[76442]:       <nova:owner>
Nov 14 20:35:29 user nova-compute[76442]:         <nova:user uuid="6a9c7939d95a4ec1b47672c31de2330a">tempest-VolumesAdminNegativeTest-1803889283-project-member</nova:user>
Nov 14 20:35:29 user nova-compute[76442]:         <nova:project uuid="f754011c54964adcb6898beac89668e1">tempest-VolumesAdminNegativeTest-1803889283</nova:project>
Nov 14 20:35:29 user nova-compute[76442]:       </nova:owner>
Nov 14 20:35:29 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:35:29 user nova-compute[76442]:       <nova:ports>
Nov 14 20:35:29 user nova-compute[76442]:         <nova:port uuid="0b7921ee-3266-4e01-996e-b9f62b1b589a">
Nov 14 20:35:29 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 20:35:29 user nova-compute[76442]:         </nova:port>
Nov 14 20:35:29 user nova-compute[76442]:       </nova:ports>
Nov 14 20:35:29 user nova-compute[76442]:     </nova:instance>
Nov 14 20:35:29 user nova-compute[76442]:   </metadata>
Nov 14 20:35:29 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:35:29 user nova-compute[76442]:     <system>
Nov 14 20:35:29 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:35:29 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:35:29 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:35:29 user nova-compute[76442]:       <entry name="serial">24c3abec-1233-45d1-a5ce-d5a14f76b313</entry>
Nov 14 20:35:29 user nova-compute[76442]:       <entry name="uuid">24c3abec-1233-45d1-a5ce-d5a14f76b313</entry>
Nov 14 20:35:29 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:35:29 user nova-compute[76442]:     </system>
Nov 14 20:35:29 user nova-compute[76442]:   </sysinfo>
Nov 14 20:35:29 user nova-compute[76442]:   <os>
Nov 14 20:35:29 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:35:29 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:35:29 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:35:29 user nova-compute[76442]:   </os>
Nov 14 20:35:29 user nova-compute[76442]:   <features>
Nov 14 20:35:29 user nova-compute[76442]:     <acpi/>
Nov 14 20:35:29 user nova-compute[76442]:     <apic/>
Nov 14 20:35:29 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:35:29 user nova-compute[76442]:   </features>
Nov 14 20:35:29 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:35:29 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:35:29 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:35:29 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:35:29 user nova-compute[76442]:   </clock>
Nov 14 20:35:29 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:35:29 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:35:29 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:35:29 user nova-compute[76442]:   </cpu>
Nov 14 20:35:29 user nova-compute[76442]:   <devices>
Nov 14 20:35:29 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:35:29 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:35:29 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk"/>
Nov 14 20:35:29 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:35:29 user nova-compute[76442]:     </disk>
Nov 14 20:35:29 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:35:29 user nova-compute[76442]:       <mac address="fa:16:3e:09:16:af"/>
Nov 14 20:35:29 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:29 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:35:29 user nova-compute[76442]:       <target dev="tap0b7921ee-32"/>
Nov 14 20:35:29 user nova-compute[76442]:     </interface>
Nov 14 20:35:29 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:35:29 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/console.log" append="off"/>
Nov 14 20:35:29 user nova-compute[76442]:     </serial>
Nov 14 20:35:29 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:35:29 user nova-compute[76442]:     <video>
Nov 14 20:35:29 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:29 user nova-compute[76442]:     </video>
Nov 14 20:35:29 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:35:29 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:35:29 user nova-compute[76442]:     </rng>
Nov 14 20:35:29 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:35:29 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:35:29 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:35:29 user nova-compute[76442]:     </memballoon>
Nov 14 20:35:29 user nova-compute[76442]:   </devices>
Nov 14 20:35:29 user nova-compute[76442]: </domain>
Nov 14 20:35:29 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1197385494',display_name='tempest-VolumesAdminNegativeTest-server-1197385494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1197385494',id=6,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlQHpySRIAnXadiOnW4wVNWS/67tXiq06Y9Mb5qaH10uQ7UGVUIteSSLi7+eutxBekv/S+UNrYx3C8FXyBvBHms4e6VZ8rFq0VFHG7ZcfgVZIIboSf7Wra/p33BJbVC4Q==',key_name='tempest-keypair-2112243525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f754011c54964adcb6898beac89668e1',ramdisk_id='',reservation_id='r-a10fuxk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1803889283',owner_user_name='tempest-VolumesAdminNegativeTest-1803889283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a9c7939d95a4ec1b47672c31de2330a',uuid=24c3abec-1233-45d1-a5ce-d5a14f76b313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converting VIF {"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:16:af,bridge_name='br-int',has_traffic_filtering=True,id=0b7921ee-3266-4e01-996e-b9f62b1b589a,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7921ee-32') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG os_vif [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:16:af,bridge_name='br-int',has_traffic_filtering=True,id=0b7921ee-3266-4e01-996e-b9f62b1b589a,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7921ee-32') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8482eb1e-e043-520b-a9b9-0baa83ffa9a2', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987 --force-share --output=json" returned: 0 in 0.245s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987,backing_fmt=raw /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b7921ee-32, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b7921ee-32, col_values=(('qos', UUID('74031b22-5611-4fd4-b385-9a62a80197cf')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b7921ee-32, col_values=(('external_ids', {'iface-id': '0b7921ee-3266-4e01-996e-b9f62b1b589a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:16:af', 'vm-uuid': '24c3abec-1233-45d1-a5ce-d5a14f76b313'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987,backing_fmt=raw /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk 1073741824" returned: 0 in 0.082s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "957a671ff535b421fc0857dae43576e9d6d3a987" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.policy [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea5cd68ca82b403894574c8cca866c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19f15871cfc46a797bebbc7b4bd98c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:29 user nova-compute[76442]: INFO os_vif [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:16:af,bridge_name='br-int',has_traffic_filtering=True,id=0b7921ee-3266-4e01-996e-b9f62b1b589a,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7921ee-32')
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:35:29 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Creating image(s)
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Successfully created port: 647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received event network-vif-plugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] No waiting events found dispatching network-vif-plugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:29 user nova-compute[76442]: WARNING nova.compute.manager [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received unexpected event network-vif-plugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 for instance with vm_state active and task_state None.
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received event network-changed-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Refreshing instance network info cache due to event network-changed-0b7921ee-3266-4e01-996e-b9f62b1b589a. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] Acquiring lock "refresh_cache-24c3abec-1233-45d1-a5ce-d5a14f76b313" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] Acquired lock "refresh_cache-24c3abec-1233-45d1-a5ce-d5a14f76b313" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:29 user nova-compute[76442]: DEBUG nova.network.neutron [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Refreshing network info cache for port 0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] No VIF found with MAC fa:16:3e:09:16:af, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987 --force-share --output=json" returned: 0 in 0.266s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.252s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Cannot resize image /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Ensure instance console log exists: /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.209s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk 1073741824" returned: 0 in 0.089s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.212s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:35:30 user nova-compute[76442]: INFO nova.compute.claims [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Claim successful on node user
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Cannot resize image /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Ensure instance console log exists: /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Updated VIF entry in instance network info cache for port 0b7921ee-3266-4e01-996e-b9f62b1b589a. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Updating instance_info_cache with network_info: [{"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f4e923fc-fbbf-4541-8d9e-17120fff1e3b req-eaee91ea-4d81-4e6b-8e72-f853a598fe8b service nova] Releasing lock "refresh_cache-24c3abec-1233-45d1-a5ce-d5a14f76b313" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Successfully updated port: 647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "refresh_cache-36d98f74-5652-445d-a06a-14b59aa3fa80" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquired lock "refresh_cache-36d98f74-5652-445d-a06a-14b59aa3fa80" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-8c3fd4d0-4ef7-4d3c-a7cf-4385e415adbd req-7a8c18a2-18bc-4fa0-a182-4b3010e19089 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received event network-changed-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-8c3fd4d0-4ef7-4d3c-a7cf-4385e415adbd req-7a8c18a2-18bc-4fa0-a182-4b3010e19089 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Refreshing instance network info cache due to event network-changed-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8c3fd4d0-4ef7-4d3c-a7cf-4385e415adbd req-7a8c18a2-18bc-4fa0-a182-4b3010e19089 service nova] Acquiring lock "refresh_cache-36d98f74-5652-445d-a06a-14b59aa3fa80" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Successfully created port: 419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.802s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.network.neutron [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:35:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.policy [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d576e790f184aeaa8824ff4b1670de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f702e947c58d4ab5a957e783ca4a0f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:35:31 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:35:32 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Creating image(s)
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "/opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "/opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "/opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.216s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.338s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk 1073741824" returned: 0 in 0.089s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.433s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Updating instance_info_cache with network_info: [{"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.202s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Releasing lock "refresh_cache-36d98f74-5652-445d-a06a-14b59aa3fa80" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Instance network_info: |[{"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8c3fd4d0-4ef7-4d3c-a7cf-4385e415adbd req-7a8c18a2-18bc-4fa0-a182-4b3010e19089 service nova] Acquired lock "refresh_cache-36d98f74-5652-445d-a06a-14b59aa3fa80" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-8c3fd4d0-4ef7-4d3c-a7cf-4385e415adbd req-7a8c18a2-18bc-4fa0-a182-4b3010e19089 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Refreshing network info cache for port 647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:35:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Start _get_guest_xml network_info=[{"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:35:16Z,direct_url=<?>,disk_format='qcow2',id=464f0a50-254e-4c17-a79f-6f6ef3e7500d,min_disk=0,min_ram=0,name='',owner='cce49c4385904ca99dfc5936a280be43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:35:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '464f0a50-254e-4c17-a79f-6f6ef3e7500d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:35:32 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:33 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:35:16Z,direct_url=<?>,disk_format='qcow2',id=464f0a50-254e-4c17-a79f-6f6ef3e7500d,min_disk=0,min_ram=0,name='',owner='cce49c4385904ca99dfc5936a280be43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:35:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1117583019',display_name='tempest-AttachSCSIVolumeTestJSON-server-1117583019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1117583019',id=7,image_ref='464f0a50-254e-4c17-a79f-6f6ef3e7500d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjHqFQTr25/QezRNK9vi8w5D4A9tgjdzFHDHo5KRY15y5o7TZos5q+XKnZpgkHVg3j7FZy2QZbqbecM7PgpY5lgd2w2bypMpR20rS7FDIjAz0H4SFh4mRtSCBMgZGDf+A==',key_name='tempest-keypair-610964722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dde59546f394a5a9da91dfbf0b887a5',ramdisk_id='',reservation_id='r-1q765cp5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='464f0a50-254e-4c17-a79f-6f6ef3e7500d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2030925873',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2030925873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='719ba1f189744fbda79093cdf7f4bbfa',uuid=36d98f74-5652-445d-a06a-14b59aa3fa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Converting VIF {"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=647bee4f-1167-49c0-9e8b-7d0fef7ebdf7,network=Network(55009253-dbe9-4a2d-b209-b0bea87f83a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bee4f-11') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lazy-loading 'pci_devices' on Instance uuid 36d98f74-5652-445d-a06a-14b59aa3fa80 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:35:33 user nova-compute[76442]:   <uuid>36d98f74-5652-445d-a06a-14b59aa3fa80</uuid>
Nov 14 20:35:33 user nova-compute[76442]:   <name>instance-00000007</name>
Nov 14 20:35:33 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:35:33 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:35:33 user nova-compute[76442]:   <metadata>
Nov 14 20:35:33 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:35:33 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:35:33 user nova-compute[76442]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1117583019</nova:name>
Nov 14 20:35:33 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:35:33</nova:creationTime>
Nov 14 20:35:33 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:35:33 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:35:33 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:35:33 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:35:33 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:35:33 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:35:33 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:35:33 user nova-compute[76442]:       <nova:owner>
Nov 14 20:35:33 user nova-compute[76442]:         <nova:user uuid="719ba1f189744fbda79093cdf7f4bbfa">tempest-AttachSCSIVolumeTestJSON-2030925873-project-member</nova:user>
Nov 14 20:35:33 user nova-compute[76442]:         <nova:project uuid="5dde59546f394a5a9da91dfbf0b887a5">tempest-AttachSCSIVolumeTestJSON-2030925873</nova:project>
Nov 14 20:35:33 user nova-compute[76442]:       </nova:owner>
Nov 14 20:35:33 user nova-compute[76442]:       <nova:root type="image" uuid="464f0a50-254e-4c17-a79f-6f6ef3e7500d"/>
Nov 14 20:35:33 user nova-compute[76442]:       <nova:ports>
Nov 14 20:35:33 user nova-compute[76442]:         <nova:port uuid="647bee4f-1167-49c0-9e8b-7d0fef7ebdf7">
Nov 14 20:35:33 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 20:35:33 user nova-compute[76442]:         </nova:port>
Nov 14 20:35:33 user nova-compute[76442]:       </nova:ports>
Nov 14 20:35:33 user nova-compute[76442]:     </nova:instance>
Nov 14 20:35:33 user nova-compute[76442]:   </metadata>
Nov 14 20:35:33 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:35:33 user nova-compute[76442]:     <system>
Nov 14 20:35:33 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:35:33 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:35:33 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:35:33 user nova-compute[76442]:       <entry name="serial">36d98f74-5652-445d-a06a-14b59aa3fa80</entry>
Nov 14 20:35:33 user nova-compute[76442]:       <entry name="uuid">36d98f74-5652-445d-a06a-14b59aa3fa80</entry>
Nov 14 20:35:33 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:35:33 user nova-compute[76442]:     </system>
Nov 14 20:35:33 user nova-compute[76442]:   </sysinfo>
Nov 14 20:35:33 user nova-compute[76442]:   <os>
Nov 14 20:35:33 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:35:33 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:35:33 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:35:33 user nova-compute[76442]:   </os>
Nov 14 20:35:33 user nova-compute[76442]:   <features>
Nov 14 20:35:33 user nova-compute[76442]:     <acpi/>
Nov 14 20:35:33 user nova-compute[76442]:     <apic/>
Nov 14 20:35:33 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:35:33 user nova-compute[76442]:   </features>
Nov 14 20:35:33 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:35:33 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:35:33 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:35:33 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:35:33 user nova-compute[76442]:   </clock>
Nov 14 20:35:33 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:35:33 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:35:33 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:35:33 user nova-compute[76442]:   </cpu>
Nov 14 20:35:33 user nova-compute[76442]:   <devices>
Nov 14 20:35:33 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:35:33 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:35:33 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk"/>
Nov 14 20:35:33 user nova-compute[76442]:       <target dev="sda" bus="scsi"/>
Nov 14 20:35:33 user nova-compute[76442]:       <address type="drive" controller="0" unit="0"/>
Nov 14 20:35:33 user nova-compute[76442]:     </disk>
Nov 14 20:35:33 user nova-compute[76442]:     <disk type="file" device="cdrom">
Nov 14 20:35:33 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 20:35:33 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk.config"/>
Nov 14 20:35:33 user nova-compute[76442]:       <target dev="sdb" bus="scsi"/>
Nov 14 20:35:33 user nova-compute[76442]:       <address type="drive" controller="0" unit="1"/>
Nov 14 20:35:33 user nova-compute[76442]:     </disk>
Nov 14 20:35:33 user nova-compute[76442]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 20:35:33 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:35:33 user nova-compute[76442]:       <mac address="fa:16:3e:cf:4c:a3"/>
Nov 14 20:35:33 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:33 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:35:33 user nova-compute[76442]:       <target dev="tap647bee4f-11"/>
Nov 14 20:35:33 user nova-compute[76442]:     </interface>
Nov 14 20:35:33 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:35:33 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/console.log" append="off"/>
Nov 14 20:35:33 user nova-compute[76442]:     </serial>
Nov 14 20:35:33 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:35:33 user nova-compute[76442]:     <video>
Nov 14 20:35:33 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:33 user nova-compute[76442]:     </video>
Nov 14 20:35:33 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:35:33 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:35:33 user nova-compute[76442]:     </rng>
Nov 14 20:35:33 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:35:33 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:35:33 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:35:33 user nova-compute[76442]:     </memballoon>
Nov 14 20:35:33 user nova-compute[76442]:   </devices>
Nov 14 20:35:33 user nova-compute[76442]: </domain>
Nov 14 20:35:33 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1117583019',display_name='tempest-AttachSCSIVolumeTestJSON-server-1117583019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1117583019',id=7,image_ref='464f0a50-254e-4c17-a79f-6f6ef3e7500d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjHqFQTr25/QezRNK9vi8w5D4A9tgjdzFHDHo5KRY15y5o7TZos5q+XKnZpgkHVg3j7FZy2QZbqbecM7PgpY5lgd2w2bypMpR20rS7FDIjAz0H4SFh4mRtSCBMgZGDf+A==',key_name='tempest-keypair-610964722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dde59546f394a5a9da91dfbf0b887a5',ramdisk_id='',reservation_id='r-1q765cp5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='464f0a50-254e-4c17-a79f-6f6ef3e7500d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2030925873',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2030925873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='719ba1f189744fbda79093cdf7f4bbfa',uuid=36d98f74-5652-445d-a06a-14b59aa3fa80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Converting VIF {"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=647bee4f-1167-49c0-9e8b-7d0fef7ebdf7,network=Network(55009253-dbe9-4a2d-b209-b0bea87f83a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bee4f-11') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG os_vif [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=647bee4f-1167-49c0-9e8b-7d0fef7ebdf7,network=Network(55009253-dbe9-4a2d-b209-b0bea87f83a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bee4f-11') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bffe126-6062-5b37-9938-806e0fb27155', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap647bee4f-11, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap647bee4f-11, col_values=(('qos', UUID('e3b422f3-b597-4c5a-b57e-20e332a44f2b')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap647bee4f-11, col_values=(('external_ids', {'iface-id': '647bee4f-1167-49c0-9e8b-7d0fef7ebdf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:4c:a3', 'vm-uuid': '36d98f74-5652-445d-a06a-14b59aa3fa80'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:33 user nova-compute[76442]: INFO os_vif [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=647bee4f-1167-49c0-9e8b-7d0fef7ebdf7,network=Network(55009253-dbe9-4a2d-b209-b0bea87f83a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bee4f-11')
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Cannot resize image /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Ensure instance console log exists: /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.network.neutron [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Successfully created port: 5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] No BDM found with device name sda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] No VIF found with MAC fa:16:3e:cf:4c:a3, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:33 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Using config drive
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Successfully updated port: 419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquired lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received event network-vif-plugged-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] No waiting events found dispatching network-vif-plugged-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:33 user nova-compute[76442]: WARNING nova.compute.manager [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received unexpected event network-vif-plugged-0b7921ee-3266-4e01-996e-b9f62b1b589a for instance with vm_state building and task_state spawning.
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received event network-vif-plugged-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] No waiting events found dispatching network-vif-plugged-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:33 user nova-compute[76442]: WARNING nova.compute.manager [req-660106b5-2053-4292-8e97-f3761b1a98dd req-dc8ffecf-0f8c-4d34-b7a3-31b78e92f251 service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received unexpected event network-vif-plugged-0b7921ee-3266-4e01-996e-b9f62b1b589a for instance with vm_state building and task_state spawning.
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-c14cc0c4-2397-4e23-b78a-07b34797a794 req-fdb02531-56db-423c-ae29-e48e605d1b17 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-changed-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-c14cc0c4-2397-4e23-b78a-07b34797a794 req-fdb02531-56db-423c-ae29-e48e605d1b17 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Refreshing instance network info cache due to event network-changed-419e15ae-a9b1-4eab-b39e-40668ff94442. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c14cc0c4-2397-4e23-b78a-07b34797a794 req-fdb02531-56db-423c-ae29-e48e605d1b17 service nova] Acquiring lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:33 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Creating config drive at /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk.config
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8rdimjsm {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8rdimjsm" returned: 0 in 0.064s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.neutron [req-8c3fd4d0-4ef7-4d3c-a7cf-4385e415adbd req-7a8c18a2-18bc-4fa0-a182-4b3010e19089 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Updated VIF entry in instance network info cache for port 647bee4f-1167-49c0-9e8b-7d0fef7ebdf7. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.neutron [req-8c3fd4d0-4ef7-4d3c-a7cf-4385e415adbd req-7a8c18a2-18bc-4fa0-a182-4b3010e19089 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Updating instance_info_cache with network_info: [{"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8c3fd4d0-4ef7-4d3c-a7cf-4385e415adbd req-7a8c18a2-18bc-4fa0-a182-4b3010e19089 service nova] Releasing lock "refresh_cache-36d98f74-5652-445d-a06a-14b59aa3fa80" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updating instance_info_cache with network_info: [{"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Releasing lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Instance network_info: |[{"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c14cc0c4-2397-4e23-b78a-07b34797a794 req-fdb02531-56db-423c-ae29-e48e605d1b17 service nova] Acquired lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.neutron [req-c14cc0c4-2397-4e23-b78a-07b34797a794 req-fdb02531-56db-423c-ae29-e48e605d1b17 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Refreshing network info cache for port 419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Start _get_guest_xml network_info=[{"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:35:34 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:34 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1907993261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1907993261',id=8,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhiKJDZyTPUP42ifz5q1yPR2La2BoXPkYuIiGMuPResfJc+REH8acsUVh7+sZXo4dZ9+7k9ar1BYGHmzCSWGtVHpMzaDRVfYcUEnOUl+Cf9Cuyjn9931vx9cWZ5wDkQA==',key_name='tempest-keypair-1903225505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19f15871cfc46a797bebbc7b4bd98c8',ramdisk_id='',reservation_id='r-ozgig145',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-882538911',owner_user_name='tempest-TaggedAttachmentsTest-882538911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5cd68ca82b403894574c8cca866c0a',uuid=d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converting VIF {"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:ab:0a,bridge_name='br-int',has_traffic_filtering=True,id=419e15ae-a9b1-4eab-b39e-40668ff94442,network=Network(828432ac-ee58-46d4-a55d-1a89bdb3b32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e15ae-a9') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.objects.instance [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lazy-loading 'pci_devices' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:35:34 user nova-compute[76442]:   <uuid>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</uuid>
Nov 14 20:35:34 user nova-compute[76442]:   <name>instance-00000008</name>
Nov 14 20:35:34 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:35:34 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:35:34 user nova-compute[76442]:   <metadata>
Nov 14 20:35:34 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:35:34 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:35:34 user nova-compute[76442]:       <nova:name>tempest-device-tagging-server-1907993261</nova:name>
Nov 14 20:35:34 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:35:34</nova:creationTime>
Nov 14 20:35:34 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:35:34 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:35:34 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:35:34 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:35:34 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:35:34 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:35:34 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:35:34 user nova-compute[76442]:       <nova:owner>
Nov 14 20:35:34 user nova-compute[76442]:         <nova:user uuid="ea5cd68ca82b403894574c8cca866c0a">tempest-TaggedAttachmentsTest-882538911-project-member</nova:user>
Nov 14 20:35:34 user nova-compute[76442]:         <nova:project uuid="d19f15871cfc46a797bebbc7b4bd98c8">tempest-TaggedAttachmentsTest-882538911</nova:project>
Nov 14 20:35:34 user nova-compute[76442]:       </nova:owner>
Nov 14 20:35:34 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:35:34 user nova-compute[76442]:       <nova:ports>
Nov 14 20:35:34 user nova-compute[76442]:         <nova:port uuid="419e15ae-a9b1-4eab-b39e-40668ff94442">
Nov 14 20:35:34 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:35:34 user nova-compute[76442]:         </nova:port>
Nov 14 20:35:34 user nova-compute[76442]:       </nova:ports>
Nov 14 20:35:34 user nova-compute[76442]:     </nova:instance>
Nov 14 20:35:34 user nova-compute[76442]:   </metadata>
Nov 14 20:35:34 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:35:34 user nova-compute[76442]:     <system>
Nov 14 20:35:34 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:35:34 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:35:34 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:35:34 user nova-compute[76442]:       <entry name="serial">d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:35:34 user nova-compute[76442]:       <entry name="uuid">d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:35:34 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:35:34 user nova-compute[76442]:     </system>
Nov 14 20:35:34 user nova-compute[76442]:   </sysinfo>
Nov 14 20:35:34 user nova-compute[76442]:   <os>
Nov 14 20:35:34 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:35:34 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:35:34 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:35:34 user nova-compute[76442]:   </os>
Nov 14 20:35:34 user nova-compute[76442]:   <features>
Nov 14 20:35:34 user nova-compute[76442]:     <acpi/>
Nov 14 20:35:34 user nova-compute[76442]:     <apic/>
Nov 14 20:35:34 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:35:34 user nova-compute[76442]:   </features>
Nov 14 20:35:34 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:35:34 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:35:34 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:35:34 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:35:34 user nova-compute[76442]:   </clock>
Nov 14 20:35:34 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:35:34 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:35:34 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:35:34 user nova-compute[76442]:   </cpu>
Nov 14 20:35:34 user nova-compute[76442]:   <devices>
Nov 14 20:35:34 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:35:34 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:35:34 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk"/>
Nov 14 20:35:34 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:35:34 user nova-compute[76442]:     </disk>
Nov 14 20:35:34 user nova-compute[76442]:     <disk type="file" device="cdrom">
Nov 14 20:35:34 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 20:35:34 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.config"/>
Nov 14 20:35:34 user nova-compute[76442]:       <target dev="hda" bus="ide"/>
Nov 14 20:35:34 user nova-compute[76442]:     </disk>
Nov 14 20:35:34 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:35:34 user nova-compute[76442]:       <mac address="fa:16:3e:18:ab:0a"/>
Nov 14 20:35:34 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:34 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:35:34 user nova-compute[76442]:       <target dev="tap419e15ae-a9"/>
Nov 14 20:35:34 user nova-compute[76442]:     </interface>
Nov 14 20:35:34 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:35:34 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log" append="off"/>
Nov 14 20:35:34 user nova-compute[76442]:     </serial>
Nov 14 20:35:34 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:35:34 user nova-compute[76442]:     <video>
Nov 14 20:35:34 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:34 user nova-compute[76442]:     </video>
Nov 14 20:35:34 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:35:34 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:35:34 user nova-compute[76442]:     </rng>
Nov 14 20:35:34 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:35:34 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:35:34 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:35:34 user nova-compute[76442]:     </memballoon>
Nov 14 20:35:34 user nova-compute[76442]:   </devices>
Nov 14 20:35:34 user nova-compute[76442]: </domain>
Nov 14 20:35:34 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1907993261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1907993261',id=8,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhiKJDZyTPUP42ifz5q1yPR2La2BoXPkYuIiGMuPResfJc+REH8acsUVh7+sZXo4dZ9+7k9ar1BYGHmzCSWGtVHpMzaDRVfYcUEnOUl+Cf9Cuyjn9931vx9cWZ5wDkQA==',key_name='tempest-keypair-1903225505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d19f15871cfc46a797bebbc7b4bd98c8',ramdisk_id='',reservation_id='r-ozgig145',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-882538911',owner_user_name='tempest-TaggedAttachmentsTest-882538911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5cd68ca82b403894574c8cca866c0a',uuid=d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converting VIF {"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:ab:0a,bridge_name='br-int',has_traffic_filtering=True,id=419e15ae-a9b1-4eab-b39e-40668ff94442,network=Network(828432ac-ee58-46d4-a55d-1a89bdb3b32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e15ae-a9') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG os_vif [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:ab:0a,bridge_name='br-int',has_traffic_filtering=True,id=419e15ae-a9b1-4eab-b39e-40668ff94442,network=Network(828432ac-ee58-46d4-a55d-1a89bdb3b32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e15ae-a9') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Successfully updated port: 5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '468ef536-e099-5f69-9f49-9dd35afe6d56', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "refresh_cache-903f5659-0c6b-46c0-a3b1-02b8ada7154a" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquired lock "refresh_cache-903f5659-0c6b-46c0-a3b1-02b8ada7154a" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap419e15ae-a9, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap419e15ae-a9, col_values=(('qos', UUID('9ec7502a-4235-43ab-a815-732cf448bb9c')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap419e15ae-a9, col_values=(('external_ids', {'iface-id': '419e15ae-a9b1-4eab-b39e-40668ff94442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:ab:0a', 'vm-uuid': 'd3f77d6b-26a2-4bfc-b3f3-52b023c0aad3'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:34 user nova-compute[76442]: INFO os_vif [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:ab:0a,bridge_name='br-int',has_traffic_filtering=True,id=419e15ae-a9b1-4eab-b39e-40668ff94442,network=Network(828432ac-ee58-46d4-a55d-1a89bdb3b32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e15ae-a9')
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] No BDM found with device name hda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] No VIF found with MAC fa:16:3e:18:ab:0a, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Using config drive
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-3e14180b-2e3f-4dcd-810f-dd09812b802d req-9659cff0-2b9e-4029-88a0-12a8f7cb1819 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received event network-changed-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-3e14180b-2e3f-4dcd-810f-dd09812b802d req-9659cff0-2b9e-4029-88a0-12a8f7cb1819 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Refreshing instance network info cache due to event network-changed-5cf3cee4-4d55-46b3-9142-8b752b4a366b. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3e14180b-2e3f-4dcd-810f-dd09812b802d req-9659cff0-2b9e-4029-88a0-12a8f7cb1819 service nova] Acquiring lock "refresh_cache-903f5659-0c6b-46c0-a3b1-02b8ada7154a" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Instance spawned successfully.
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:34 user nova-compute[76442]: INFO nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Took 10.22 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Updating instance_info_cache with network_info: [{"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Releasing lock "refresh_cache-903f5659-0c6b-46c0-a3b1-02b8ada7154a" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Instance network_info: |[{"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3e14180b-2e3f-4dcd-810f-dd09812b802d req-9659cff0-2b9e-4029-88a0-12a8f7cb1819 service nova] Acquired lock "refresh_cache-903f5659-0c6b-46c0-a3b1-02b8ada7154a" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.network.neutron [req-3e14180b-2e3f-4dcd-810f-dd09812b802d req-9659cff0-2b9e-4029-88a0-12a8f7cb1819 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Refreshing network info cache for port 5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Start _get_guest_xml network_info=[{"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:35:34 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:34 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:35:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Creating config drive at /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.config
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7160xe2m {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7160xe2m" returned: 0 in 0.080s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:34 user nova-compute[76442]: INFO nova.compute.manager [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Took 11.62 seconds to build instance.
Nov 14 20:35:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-666236591',display_name='tempest-TestVolumeSwap-server-666236591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-666236591',id=9,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs9bVdnMVrDXYACqer9Ja0fERdnnt8qg04o8F/gAZv7ysP1+WyTI2gB5ASNtTPj6rTC+nDRr8tcAjCb9IEM2C+WPBUWMx/SvcwkkZUy0GT3SziHOOXSz2Tc3VhkCvjo3A==',key_name='tempest-keypair-1154491887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f702e947c58d4ab5a957e783ca4a0f9e',ramdisk_id='',reservation_id='r-h5zqm1sv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1774718886',owner_user_name='tempest-TestVolumeSwap-1774718886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d576e790f184aeaa8824ff4b1670de9',uuid=903f5659-0c6b-46c0-a3b1-02b8ada7154a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Converting VIF {"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:3a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5cf3cee4-4d55-46b3-9142-8b752b4a366b,network=Network(bad41c3c-0b18-424b-80d4-b1524f48de7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf3cee4-4d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.objects.instance [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lazy-loading 'pci_devices' on Instance uuid 903f5659-0c6b-46c0-a3b1-02b8ada7154a {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91560940-e6f8-47c8-98d7-3f1d687506fe tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.827s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:35:35 user nova-compute[76442]:   <uuid>903f5659-0c6b-46c0-a3b1-02b8ada7154a</uuid>
Nov 14 20:35:35 user nova-compute[76442]:   <name>instance-00000009</name>
Nov 14 20:35:35 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:35:35 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:35:35 user nova-compute[76442]:   <metadata>
Nov 14 20:35:35 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:35:35 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:35:35 user nova-compute[76442]:       <nova:name>tempest-TestVolumeSwap-server-666236591</nova:name>
Nov 14 20:35:35 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:35:34</nova:creationTime>
Nov 14 20:35:35 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:35:35 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:35:35 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:35:35 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:35:35 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:35:35 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:35:35 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:35:35 user nova-compute[76442]:       <nova:owner>
Nov 14 20:35:35 user nova-compute[76442]:         <nova:user uuid="9d576e790f184aeaa8824ff4b1670de9">tempest-TestVolumeSwap-1774718886-project-member</nova:user>
Nov 14 20:35:35 user nova-compute[76442]:         <nova:project uuid="f702e947c58d4ab5a957e783ca4a0f9e">tempest-TestVolumeSwap-1774718886</nova:project>
Nov 14 20:35:35 user nova-compute[76442]:       </nova:owner>
Nov 14 20:35:35 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:35:35 user nova-compute[76442]:       <nova:ports>
Nov 14 20:35:35 user nova-compute[76442]:         <nova:port uuid="5cf3cee4-4d55-46b3-9142-8b752b4a366b">
Nov 14 20:35:35 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 20:35:35 user nova-compute[76442]:         </nova:port>
Nov 14 20:35:35 user nova-compute[76442]:       </nova:ports>
Nov 14 20:35:35 user nova-compute[76442]:     </nova:instance>
Nov 14 20:35:35 user nova-compute[76442]:   </metadata>
Nov 14 20:35:35 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:35:35 user nova-compute[76442]:     <system>
Nov 14 20:35:35 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:35:35 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:35:35 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:35:35 user nova-compute[76442]:       <entry name="serial">903f5659-0c6b-46c0-a3b1-02b8ada7154a</entry>
Nov 14 20:35:35 user nova-compute[76442]:       <entry name="uuid">903f5659-0c6b-46c0-a3b1-02b8ada7154a</entry>
Nov 14 20:35:35 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:35:35 user nova-compute[76442]:     </system>
Nov 14 20:35:35 user nova-compute[76442]:   </sysinfo>
Nov 14 20:35:35 user nova-compute[76442]:   <os>
Nov 14 20:35:35 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:35:35 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:35:35 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:35:35 user nova-compute[76442]:   </os>
Nov 14 20:35:35 user nova-compute[76442]:   <features>
Nov 14 20:35:35 user nova-compute[76442]:     <acpi/>
Nov 14 20:35:35 user nova-compute[76442]:     <apic/>
Nov 14 20:35:35 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:35:35 user nova-compute[76442]:   </features>
Nov 14 20:35:35 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:35:35 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:35:35 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:35:35 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:35:35 user nova-compute[76442]:   </clock>
Nov 14 20:35:35 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:35:35 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:35:35 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:35:35 user nova-compute[76442]:   </cpu>
Nov 14 20:35:35 user nova-compute[76442]:   <devices>
Nov 14 20:35:35 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:35:35 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:35:35 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk"/>
Nov 14 20:35:35 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:35:35 user nova-compute[76442]:     </disk>
Nov 14 20:35:35 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:35:35 user nova-compute[76442]:       <mac address="fa:16:3e:f8:3a:4e"/>
Nov 14 20:35:35 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:35 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:35:35 user nova-compute[76442]:       <target dev="tap5cf3cee4-4d"/>
Nov 14 20:35:35 user nova-compute[76442]:     </interface>
Nov 14 20:35:35 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:35:35 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/console.log" append="off"/>
Nov 14 20:35:35 user nova-compute[76442]:     </serial>
Nov 14 20:35:35 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:35:35 user nova-compute[76442]:     <video>
Nov 14 20:35:35 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:35 user nova-compute[76442]:     </video>
Nov 14 20:35:35 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:35:35 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:35:35 user nova-compute[76442]:     </rng>
Nov 14 20:35:35 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:35:35 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:35:35 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:35:35 user nova-compute[76442]:     </memballoon>
Nov 14 20:35:35 user nova-compute[76442]:   </devices>
Nov 14 20:35:35 user nova-compute[76442]: </domain>
Nov 14 20:35:35 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-666236591',display_name='tempest-TestVolumeSwap-server-666236591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-666236591',id=9,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs9bVdnMVrDXYACqer9Ja0fERdnnt8qg04o8F/gAZv7ysP1+WyTI2gB5ASNtTPj6rTC+nDRr8tcAjCb9IEM2C+WPBUWMx/SvcwkkZUy0GT3SziHOOXSz2Tc3VhkCvjo3A==',key_name='tempest-keypair-1154491887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f702e947c58d4ab5a957e783ca4a0f9e',ramdisk_id='',reservation_id='r-h5zqm1sv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1774718886',owner_user_name='tempest-TestVolumeSwap-1774718886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d576e790f184aeaa8824ff4b1670de9',uuid=903f5659-0c6b-46c0-a3b1-02b8ada7154a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Converting VIF {"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:3a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5cf3cee4-4d55-46b3-9142-8b752b4a366b,network=Network(bad41c3c-0b18-424b-80d4-b1524f48de7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf3cee4-4d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG os_vif [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:3a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5cf3cee4-4d55-46b3-9142-8b752b4a366b,network=Network(bad41c3c-0b18-424b-80d4-b1524f48de7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf3cee4-4d') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d225024-a79f-562a-a5dc-00c1c5b257b1', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-c14cc0c4-2397-4e23-b78a-07b34797a794 req-fdb02531-56db-423c-ae29-e48e605d1b17 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updated VIF entry in instance network info cache for port 419e15ae-a9b1-4eab-b39e-40668ff94442. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-c14cc0c4-2397-4e23-b78a-07b34797a794 req-fdb02531-56db-423c-ae29-e48e605d1b17 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updating instance_info_cache with network_info: [{"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c14cc0c4-2397-4e23-b78a-07b34797a794 req-fdb02531-56db-423c-ae29-e48e605d1b17 service nova] Releasing lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cf3cee4-4d, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cf3cee4-4d, col_values=(('qos', UUID('c9e39f0a-f112-4277-978e-bae15e302c25')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cf3cee4-4d, col_values=(('external_ids', {'iface-id': '5cf3cee4-4d55-46b3-9142-8b752b4a366b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:3a:4e', 'vm-uuid': '903f5659-0c6b-46c0-a3b1-02b8ada7154a'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: INFO os_vif [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:3a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5cf3cee4-4d55-46b3-9142-8b752b4a366b,network=Network(bad41c3c-0b18-424b-80d4-b1524f48de7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf3cee4-4d')
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] No VIF found with MAC fa:16:3e:f8:3a:4e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-3e14180b-2e3f-4dcd-810f-dd09812b802d req-9659cff0-2b9e-4029-88a0-12a8f7cb1819 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Updated VIF entry in instance network info cache for port 5cf3cee4-4d55-46b3-9142-8b752b4a366b. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-3e14180b-2e3f-4dcd-810f-dd09812b802d req-9659cff0-2b9e-4029-88a0-12a8f7cb1819 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Updating instance_info_cache with network_info: [{"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3e14180b-2e3f-4dcd-810f-dd09812b802d req-9659cff0-2b9e-4029-88a0-12a8f7cb1819 service nova] Releasing lock "refresh_cache-903f5659-0c6b-46c0-a3b1-02b8ada7154a" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:35 user nova-compute[76442]: WARNING nova.compute.manager [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state active and task_state None.
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:35 user nova-compute[76442]: WARNING nova.compute.manager [req-0f486f87-ae3d-4d00-92e9-9bfdcffc0317 req-c263745d-3c9c-474b-8ecb-0d4b7c4c3672 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state active and task_state None.
Nov 14 20:35:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received event network-vif-plugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] No waiting events found dispatching network-vif-plugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:37 user nova-compute[76442]: WARNING nova.compute.manager [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received unexpected event network-vif-plugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 for instance with vm_state building and task_state spawning.
Nov 14 20:35:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received event network-vif-plugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] No waiting events found dispatching network-vif-plugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:37 user nova-compute[76442]: WARNING nova.compute.manager [req-1b067cd8-2122-4641-97ec-c428ae42ba22 req-2008675e-27aa-4ec9-a0a2-30d01197ed97 service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received unexpected event network-vif-plugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 for instance with vm_state building and task_state spawning.
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-plugged-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] No waiting events found dispatching network-vif-plugged-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:39 user nova-compute[76442]: WARNING nova.compute.manager [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received unexpected event network-vif-plugged-419e15ae-a9b1-4eab-b39e-40668ff94442 for instance with vm_state building and task_state spawning.
Nov 14 20:35:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-plugged-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] No waiting events found dispatching network-vif-plugged-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:39 user nova-compute[76442]: WARNING nova.compute.manager [req-7c6d80d7-f0f6-4dac-a3fe-29c87556b49f req-7bdb8ef9-964c-4d34-8758-83eb24ac2521 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received unexpected event network-vif-plugged-419e15ae-a9b1-4eab-b39e-40668ff94442 for instance with vm_state building and task_state spawning.
Nov 14 20:35:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-ba2e0102-f27b-4f29-a633-a2336d0598d2 req-872eb284-62b8-445a-82dc-97fda7871bf2 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received event network-vif-plugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba2e0102-f27b-4f29-a633-a2336d0598d2 req-872eb284-62b8-445a-82dc-97fda7871bf2 service nova] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba2e0102-f27b-4f29-a633-a2336d0598d2 req-872eb284-62b8-445a-82dc-97fda7871bf2 service nova] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba2e0102-f27b-4f29-a633-a2336d0598d2 req-872eb284-62b8-445a-82dc-97fda7871bf2 service nova] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-ba2e0102-f27b-4f29-a633-a2336d0598d2 req-872eb284-62b8-445a-82dc-97fda7871bf2 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] No waiting events found dispatching network-vif-plugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:40 user nova-compute[76442]: WARNING nova.compute.manager [req-ba2e0102-f27b-4f29-a633-a2336d0598d2 req-872eb284-62b8-445a-82dc-97fda7871bf2 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received unexpected event network-vif-plugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b for instance with vm_state building and task_state spawning.
Nov 14 20:35:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Instance spawned successfully.
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Took 14.03 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Instance spawned successfully.
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Instance spawned successfully.
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.compute.manager [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Took 15.52 seconds to build instance.
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Took 11.84 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3960cd2-ddc3-4bf3-8e9d-1912e75c73b2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.744s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Took 9.77 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.compute.manager [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Took 13.43 seconds to build instance.
Nov 14 20:35:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1177469c-6c42-432e-a5df-5f84944a27c5 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.659s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.compute.claims [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Claim successful on node user
Nov 14 20:35:41 user nova-compute[76442]: INFO nova.compute.manager [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Took 11.11 seconds to build instance.
Nov 14 20:35:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-398905d8-dc24-45eb-9d40-5d625f460efc tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.315s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-3d6ff541-0d27-42b3-9f0f-e7c43c10f611 req-bae2c807-64be-4a4e-b67a-1d56d318a1ec service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received event network-vif-plugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3d6ff541-0d27-42b3-9f0f-e7c43c10f611 req-bae2c807-64be-4a4e-b67a-1d56d318a1ec service nova] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3d6ff541-0d27-42b3-9f0f-e7c43c10f611 req-bae2c807-64be-4a4e-b67a-1d56d318a1ec service nova] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3d6ff541-0d27-42b3-9f0f-e7c43c10f611 req-bae2c807-64be-4a4e-b67a-1d56d318a1ec service nova] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-3d6ff541-0d27-42b3-9f0f-e7c43c10f611 req-bae2c807-64be-4a4e-b67a-1d56d318a1ec service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] No waiting events found dispatching network-vif-plugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:42 user nova-compute[76442]: WARNING nova.compute.manager [req-3d6ff541-0d27-42b3-9f0f-e7c43c10f611 req-bae2c807-64be-4a4e-b67a-1d56d318a1ec service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received unexpected event network-vif-plugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b for instance with vm_state active and task_state None.
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-25cca44d-6327-403f-82e5-09a6c0edc582 req-9319a141-9147-4fca-a7c7-961a0a20fe0a service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received event network-vif-plugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-25cca44d-6327-403f-82e5-09a6c0edc582 req-9319a141-9147-4fca-a7c7-961a0a20fe0a service nova] Acquiring lock "15e2beda-544e-419b-b345-99f439670e0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-25cca44d-6327-403f-82e5-09a6c0edc582 req-9319a141-9147-4fca-a7c7-961a0a20fe0a service nova] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-25cca44d-6327-403f-82e5-09a6c0edc582 req-9319a141-9147-4fca-a7c7-961a0a20fe0a service nova] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-25cca44d-6327-403f-82e5-09a6c0edc582 req-9319a141-9147-4fca-a7c7-961a0a20fe0a service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] No waiting events found dispatching network-vif-plugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:42 user nova-compute[76442]: WARNING nova.compute.manager [req-25cca44d-6327-403f-82e5-09a6c0edc582 req-9319a141-9147-4fca-a7c7-961a0a20fe0a service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received unexpected event network-vif-plugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c for instance with vm_state active and task_state None.
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:35:42 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.policy [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee972d4901b142578a9c345a32023a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0612cd66b9904d1298c13987fed353c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:35:42 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Creating image(s)
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquiring lock "/opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "/opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "/opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.249s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.264s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk 1073741824" returned: 0 in 0.061s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.216s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Cannot resize image /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Ensure instance console log exists: /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:44 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Successfully created port: d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:35:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-7cf51baa-df0f-434f-b2d7-c23a9c20ade8 req-4f6171b2-7893-48b2-ba01-264e2c7fd67c service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received event network-vif-plugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7cf51baa-df0f-434f-b2d7-c23a9c20ade8 req-4f6171b2-7893-48b2-ba01-264e2c7fd67c service nova] Acquiring lock "15e2beda-544e-419b-b345-99f439670e0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7cf51baa-df0f-434f-b2d7-c23a9c20ade8 req-4f6171b2-7893-48b2-ba01-264e2c7fd67c service nova] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7cf51baa-df0f-434f-b2d7-c23a9c20ade8 req-4f6171b2-7893-48b2-ba01-264e2c7fd67c service nova] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-7cf51baa-df0f-434f-b2d7-c23a9c20ade8 req-4f6171b2-7893-48b2-ba01-264e2c7fd67c service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] No waiting events found dispatching network-vif-plugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:44 user nova-compute[76442]: WARNING nova.compute.manager [req-7cf51baa-df0f-434f-b2d7-c23a9c20ade8 req-4f6171b2-7893-48b2-ba01-264e2c7fd67c service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received unexpected event network-vif-plugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c for instance with vm_state active and task_state None.
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Successfully updated port: d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquiring lock "refresh_cache-2109949f-44c3-40d9-bed6-aef35fa5b8cd" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquired lock "refresh_cache-2109949f-44c3-40d9-bed6-aef35fa5b8cd" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Updating instance_info_cache with network_info: [{"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Releasing lock "refresh_cache-2109949f-44c3-40d9-bed6-aef35fa5b8cd" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Instance network_info: |[{"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Start _get_guest_xml network_info=[{"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:35:45 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:45 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1744602981',display_name='tempest-VolumesAssistedSnapshotsTest-server-1744602981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1744602981',id=10,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM49O2EflI2sISbHPvkOEFj/vPbqAStnkhRUadMRgMbFhOVeSCBVfED8wmWNVW7pWUtBfo5OqmgWO2z7tOx1YDgswfXLZl1YZ+eOTptUt3yeTi42NoIMT3ofH4PAfMlSMw==',key_name='tempest-keypair-11076927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0612cd66b9904d1298c13987fed353c8',ramdisk_id='',reservation_id='r-osie0sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-37670104',owner_user_name='tempest-VolumesAssistedSnapshotsTest-37670104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee972d4901b142578a9c345a32023a62',uuid=2109949f-44c3-40d9-bed6-aef35fa5b8cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Converting VIF {"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f4:bb,bridge_name='br-int',has_traffic_filtering=True,id=d83cd1ac-7bcb-41ab-9a52-1102818d6189,network=Network(b1915058-fb35-456b-97ed-6bfbe56d5a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83cd1ac-7b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.objects.instance [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lazy-loading 'pci_devices' on Instance uuid 2109949f-44c3-40d9-bed6-aef35fa5b8cd {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:35:45 user nova-compute[76442]:   <uuid>2109949f-44c3-40d9-bed6-aef35fa5b8cd</uuid>
Nov 14 20:35:45 user nova-compute[76442]:   <name>instance-0000000a</name>
Nov 14 20:35:45 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:35:45 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:35:45 user nova-compute[76442]:   <metadata>
Nov 14 20:35:45 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:35:45 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:35:45 user nova-compute[76442]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1744602981</nova:name>
Nov 14 20:35:45 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:35:45</nova:creationTime>
Nov 14 20:35:45 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:35:45 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:35:45 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:35:45 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:35:45 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:35:45 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:35:45 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:35:45 user nova-compute[76442]:       <nova:owner>
Nov 14 20:35:45 user nova-compute[76442]:         <nova:user uuid="ee972d4901b142578a9c345a32023a62">tempest-VolumesAssistedSnapshotsTest-37670104-project-member</nova:user>
Nov 14 20:35:45 user nova-compute[76442]:         <nova:project uuid="0612cd66b9904d1298c13987fed353c8">tempest-VolumesAssistedSnapshotsTest-37670104</nova:project>
Nov 14 20:35:45 user nova-compute[76442]:       </nova:owner>
Nov 14 20:35:45 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:35:45 user nova-compute[76442]:       <nova:ports>
Nov 14 20:35:45 user nova-compute[76442]:         <nova:port uuid="d83cd1ac-7bcb-41ab-9a52-1102818d6189">
Nov 14 20:35:45 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 20:35:45 user nova-compute[76442]:         </nova:port>
Nov 14 20:35:45 user nova-compute[76442]:       </nova:ports>
Nov 14 20:35:45 user nova-compute[76442]:     </nova:instance>
Nov 14 20:35:45 user nova-compute[76442]:   </metadata>
Nov 14 20:35:45 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:35:45 user nova-compute[76442]:     <system>
Nov 14 20:35:45 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:35:45 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:35:45 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:35:45 user nova-compute[76442]:       <entry name="serial">2109949f-44c3-40d9-bed6-aef35fa5b8cd</entry>
Nov 14 20:35:45 user nova-compute[76442]:       <entry name="uuid">2109949f-44c3-40d9-bed6-aef35fa5b8cd</entry>
Nov 14 20:35:45 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:35:45 user nova-compute[76442]:     </system>
Nov 14 20:35:45 user nova-compute[76442]:   </sysinfo>
Nov 14 20:35:45 user nova-compute[76442]:   <os>
Nov 14 20:35:45 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:35:45 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:35:45 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:35:45 user nova-compute[76442]:   </os>
Nov 14 20:35:45 user nova-compute[76442]:   <features>
Nov 14 20:35:45 user nova-compute[76442]:     <acpi/>
Nov 14 20:35:45 user nova-compute[76442]:     <apic/>
Nov 14 20:35:45 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:35:45 user nova-compute[76442]:   </features>
Nov 14 20:35:45 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:35:45 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:35:45 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:35:45 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:35:45 user nova-compute[76442]:   </clock>
Nov 14 20:35:45 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:35:45 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:35:45 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:35:45 user nova-compute[76442]:   </cpu>
Nov 14 20:35:45 user nova-compute[76442]:   <devices>
Nov 14 20:35:45 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:35:45 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:35:45 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk"/>
Nov 14 20:35:45 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:35:45 user nova-compute[76442]:     </disk>
Nov 14 20:35:45 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:35:45 user nova-compute[76442]:       <mac address="fa:16:3e:3d:f4:bb"/>
Nov 14 20:35:45 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:45 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:35:45 user nova-compute[76442]:       <target dev="tapd83cd1ac-7b"/>
Nov 14 20:35:45 user nova-compute[76442]:     </interface>
Nov 14 20:35:45 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:35:45 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/console.log" append="off"/>
Nov 14 20:35:45 user nova-compute[76442]:     </serial>
Nov 14 20:35:45 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:35:45 user nova-compute[76442]:     <video>
Nov 14 20:35:45 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:35:45 user nova-compute[76442]:     </video>
Nov 14 20:35:45 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:35:45 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:35:45 user nova-compute[76442]:     </rng>
Nov 14 20:35:45 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:35:45 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:35:45 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:35:45 user nova-compute[76442]:     </memballoon>
Nov 14 20:35:45 user nova-compute[76442]:   </devices>
Nov 14 20:35:45 user nova-compute[76442]: </domain>
Nov 14 20:35:45 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1744602981',display_name='tempest-VolumesAssistedSnapshotsTest-server-1744602981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1744602981',id=10,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM49O2EflI2sISbHPvkOEFj/vPbqAStnkhRUadMRgMbFhOVeSCBVfED8wmWNVW7pWUtBfo5OqmgWO2z7tOx1YDgswfXLZl1YZ+eOTptUt3yeTi42NoIMT3ofH4PAfMlSMw==',key_name='tempest-keypair-11076927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0612cd66b9904d1298c13987fed353c8',ramdisk_id='',reservation_id='r-osie0sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-37670104',owner_user_name='tempest-VolumesAssistedSnapshotsTest-37670104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:35:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee972d4901b142578a9c345a32023a62',uuid=2109949f-44c3-40d9-bed6-aef35fa5b8cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Converting VIF {"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f4:bb,bridge_name='br-int',has_traffic_filtering=True,id=d83cd1ac-7bcb-41ab-9a52-1102818d6189,network=Network(b1915058-fb35-456b-97ed-6bfbe56d5a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83cd1ac-7b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG os_vif [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f4:bb,bridge_name='br-int',has_traffic_filtering=True,id=d83cd1ac-7bcb-41ab-9a52-1102818d6189,network=Network(b1915058-fb35-456b-97ed-6bfbe56d5a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83cd1ac-7b') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ba2ea13-8c57-5c12-875d-8dc11da6d7f4', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd83cd1ac-7b, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd83cd1ac-7b, col_values=(('qos', UUID('27564054-d45c-481f-aa8c-088a49f12223')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd83cd1ac-7b, col_values=(('external_ids', {'iface-id': 'd83cd1ac-7bcb-41ab-9a52-1102818d6189', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:f4:bb', 'vm-uuid': '2109949f-44c3-40d9-bed6-aef35fa5b8cd'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:45 user nova-compute[76442]: INFO os_vif [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f4:bb,bridge_name='br-int',has_traffic_filtering=True,id=d83cd1ac-7bcb-41ab-9a52-1102818d6189,network=Network(b1915058-fb35-456b-97ed-6bfbe56d5a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83cd1ac-7b')
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] No VIF found with MAC fa:16:3e:3d:f4:bb, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:35:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-b78c65d9-5486-4fab-986c-675883000b18 req-439e2267-e2bd-47d6-a350-1c97550bd0ad service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received event network-changed-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-b78c65d9-5486-4fab-986c-675883000b18 req-439e2267-e2bd-47d6-a350-1c97550bd0ad service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Refreshing instance network info cache due to event network-changed-d83cd1ac-7bcb-41ab-9a52-1102818d6189. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:35:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b78c65d9-5486-4fab-986c-675883000b18 req-439e2267-e2bd-47d6-a350-1c97550bd0ad service nova] Acquiring lock "refresh_cache-2109949f-44c3-40d9-bed6-aef35fa5b8cd" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b78c65d9-5486-4fab-986c-675883000b18 req-439e2267-e2bd-47d6-a350-1c97550bd0ad service nova] Acquired lock "refresh_cache-2109949f-44c3-40d9-bed6-aef35fa5b8cd" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-b78c65d9-5486-4fab-986c-675883000b18 req-439e2267-e2bd-47d6-a350-1c97550bd0ad service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Refreshing network info cache for port d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-b78c65d9-5486-4fab-986c-675883000b18 req-439e2267-e2bd-47d6-a350-1c97550bd0ad service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Updated VIF entry in instance network info cache for port d83cd1ac-7bcb-41ab-9a52-1102818d6189. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-b78c65d9-5486-4fab-986c-675883000b18 req-439e2267-e2bd-47d6-a350-1c97550bd0ad service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Updating instance_info_cache with network_info: [{"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b78c65d9-5486-4fab-986c-675883000b18 req-439e2267-e2bd-47d6-a350-1c97550bd0ad service nova] Releasing lock "refresh_cache-2109949f-44c3-40d9-bed6-aef35fa5b8cd" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-f75f19d9-fe40-4fcb-b87a-96226083a900 req-47f3cc93-3e79-46e7-bac9-103ee6b14ddc service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received event network-vif-plugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f75f19d9-fe40-4fcb-b87a-96226083a900 req-47f3cc93-3e79-46e7-bac9-103ee6b14ddc service nova] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f75f19d9-fe40-4fcb-b87a-96226083a900 req-47f3cc93-3e79-46e7-bac9-103ee6b14ddc service nova] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f75f19d9-fe40-4fcb-b87a-96226083a900 req-47f3cc93-3e79-46e7-bac9-103ee6b14ddc service nova] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-f75f19d9-fe40-4fcb-b87a-96226083a900 req-47f3cc93-3e79-46e7-bac9-103ee6b14ddc service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] No waiting events found dispatching network-vif-plugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:47 user nova-compute[76442]: WARNING nova.compute.manager [req-f75f19d9-fe40-4fcb-b87a-96226083a900 req-47f3cc93-3e79-46e7-bac9-103ee6b14ddc service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received unexpected event network-vif-plugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 for instance with vm_state building and task_state spawning.
Nov 14 20:35:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-4b43df5e-414d-4abc-b8d0-931e9e3c3a84 req-a9c9b4e5-0ce3-4511-9979-93b90bb498be service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received event network-vif-plugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4b43df5e-414d-4abc-b8d0-931e9e3c3a84 req-a9c9b4e5-0ce3-4511-9979-93b90bb498be service nova] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4b43df5e-414d-4abc-b8d0-931e9e3c3a84 req-a9c9b4e5-0ce3-4511-9979-93b90bb498be service nova] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4b43df5e-414d-4abc-b8d0-931e9e3c3a84 req-a9c9b4e5-0ce3-4511-9979-93b90bb498be service nova] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-4b43df5e-414d-4abc-b8d0-931e9e3c3a84 req-a9c9b4e5-0ce3-4511-9979-93b90bb498be service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] No waiting events found dispatching network-vif-plugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:35:49 user nova-compute[76442]: WARNING nova.compute.manager [req-4b43df5e-414d-4abc-b8d0-931e9e3c3a84 req-a9c9b4e5-0ce3-4511-9979-93b90bb498be service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received unexpected event network-vif-plugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 for instance with vm_state building and task_state spawning.
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:35:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Instance spawned successfully.
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:35:49 user nova-compute[76442]: INFO nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Took 7.13 seconds to spawn the instance on the hypervisor.
Nov 14 20:35:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:35:50 user nova-compute[76442]: INFO nova.compute.manager [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Took 8.30 seconds to build instance.
Nov 14 20:35:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fe0615e9-cb54-4a1a-ae57-ba756f7ebb5b tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.429s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 20:35:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 20:35:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 20:35:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:35:54 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:54 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:54 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:35:56 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:35:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 20:35:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:35:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:35:56 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:35:56 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid a5970cb5-3f09-43c8-93ac-03053bc2f2cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updating instance_info_cache with network_info: [{"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:35:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:01 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:36:01 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:36:01 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7280MB free_disk=25.554954528808594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 15e2beda-544e-419b-b345-99f439670e0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance da018992-79f4-4db3-bbf7-a492508ff629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 36d98f74-5652-445d-a06a-14b59aa3fa80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 81e9fdfe-5853-4728-9618-d50ee80fa7fb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.766s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.527s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:02 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:36:02 user nova-compute[76442]: INFO nova.compute.claims [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Claim successful on node user
Nov 14 20:36:03 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:36:03 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:36:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:36:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:36:03 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:36:03 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:36:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:36:03 user nova-compute[76442]: INFO nova.virt.block_device [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Booting with volume fe076475-7ca4-485f-b29e-911181ec6c42 at /dev/vda
Nov 14 20:36:03 user nova-compute[76442]: DEBUG nova.policy [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '271920a06b1747949cea79a6e815098e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccb4e840f4141baab5c71494e39ece0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:36:03 user nova-compute[76442]: DEBUG os_brick.utils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:03 user nova-compute[76442]: INFO oslo.privsep.daemon [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpna3yh48e/privsep.sock']
Nov 14 20:36:03 user sudo[87613]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpna3yh48e/privsep.sock
Nov 14 20:36:03 user sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 20:36:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully created port: 30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:36:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully created port: 5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:36:04 user sudo[87613]: pam_unix(sudo:session): session closed for user root
Nov 14 20:36:04 user nova-compute[76442]: INFO oslo.privsep.daemon [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Spawned new privsep daemon via rootwrap
Nov 14 20:36:04 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 20:36:04 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 20:36:04 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 20:36:04 user nova-compute[76442]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87657
Nov 14 20:36:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[730f4f62-f99e-43b3-9a58-6779da9dc364]: (2,) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6caa375-e017-465b-82cd-b3d823ae573a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:04 user nova-compute[76442]: WARNING os_brick.initiator.connectors.nvmeof [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 20:36:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9771eae-1b0b-4109-90ff-a87be0670c8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeeebe3-1739-406a-a6f2-ad7577da4299]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8354d79-20c1-4544-8455-207d4d187424]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:05 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:36:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8738f065-4f99-47d9-adc4-6fce44e1340b]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG os_brick.utils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] <== get_connector_properties: return (1685ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating existing volume attachment record: bf201307-82bf-4f13-aec1-9cd3180ca313 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully created port: ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully created port: e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:06 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully created port: abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:36:06 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully updated port: 30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:36:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-1a2fa45f-ae30-4d36-92f7-38ab062510b3 req-fd951573-26f1-43a0-9f15-11b100a372dc service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-changed-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-1a2fa45f-ae30-4d36-92f7-38ab062510b3 req-fd951573-26f1-43a0-9f15-11b100a372dc service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing instance network info cache due to event network-changed-30298928-9818-41f6-a56d-0a5b574e138f. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1a2fa45f-ae30-4d36-92f7-38ab062510b3 req-fd951573-26f1-43a0-9f15-11b100a372dc service nova] Acquiring lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1a2fa45f-ae30-4d36-92f7-38ab062510b3 req-fd951573-26f1-43a0-9f15-11b100a372dc service nova] Acquired lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:06 user nova-compute[76442]: DEBUG nova.network.neutron [req-1a2fa45f-ae30-4d36-92f7-38ab062510b3 req-fd951573-26f1-43a0-9f15-11b100a372dc service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing network info cache for port 30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:07 user nova-compute[76442]: DEBUG nova.network.neutron [req-1a2fa45f-ae30-4d36-92f7-38ab062510b3 req-fd951573-26f1-43a0-9f15-11b100a372dc service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:36:07 user nova-compute[76442]: DEBUG nova.network.neutron [req-1a2fa45f-ae30-4d36-92f7-38ab062510b3 req-fd951573-26f1-43a0-9f15-11b100a372dc service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1a2fa45f-ae30-4d36-92f7-38ab062510b3 req-fd951573-26f1-43a0-9f15-11b100a372dc service nova] Releasing lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:07 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully updated port: b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:36:08 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully updated port: 3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:36:08 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully updated port: 5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:36:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-changed-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing instance network info cache due to event network-changed-b6f81cf9-1b2d-4626-9a1d-6799ecf54357. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] Acquiring lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] Acquired lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:08 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing network info cache for port b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully updated port: ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] Releasing lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-changed-3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing instance network info cache due to event network-changed-3884676d-16e2-4ae9-ae67-f545426a2a28. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] Acquiring lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] Acquired lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing network info cache for port 3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] Releasing lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-changed-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing instance network info cache due to event network-changed-5480900f-7611-41fc-95d7-9ad901637d7a. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] Acquiring lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] Acquired lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing network info cache for port 5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:09 user nova-compute[76442]: INFO nova.virt.block_device [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Booting with volume dde8b95b-78dc-40c8-8db9-05da1b79d495 at /dev/vdb
Nov 14 20:36:09 user nova-compute[76442]: DEBUG os_brick.utils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0f5d30-bf55-4d97-a471-98b6db2f90d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[576aded6-df6f-4e00-9d87-9b57055b6cf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdebe9e5-b91c-4b65-b3d1-a9fa9a55d563]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdea8915-5a7c-407c-851c-f7b1bd89e20a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:09 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[125cef8d-6f24-4778-ad7a-6c59033adb9e]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG os_brick.utils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating existing volume attachment record: a1715c29-ce67-4a7e-a061-a91f107e3cb7 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e640146-7029-4dd2-9059-ffc67e16c84f req-ffdd945e-7634-4794-85b4-5c749c81a5ef service nova] Releasing lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:10 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully updated port: e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:36:10 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Successfully updated port: abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:36:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquired lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:10 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:36:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:10 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:36:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-changed-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing instance network info cache due to event network-changed-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] Acquiring lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG nova.network.neutron [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [{"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Releasing lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Instance network_info: |[{"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] Acquired lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG nova.network.neutron [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing network info cache for port ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG nova.network.neutron [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updated VIF entry in instance network info cache for port ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG nova.network.neutron [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [{"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] Releasing lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-changed-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing instance network info cache due to event network-changed-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] Acquiring lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] Acquired lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:12 user nova-compute[76442]: DEBUG nova.network.neutron [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing network info cache for port e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updated VIF entry in instance network info cache for port e3916fc6-9f0b-4f37-bd71-9e809b1e72a3. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [{"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] Releasing lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-changed-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing instance network info cache due to event network-changed-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] Acquiring lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] Acquired lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing network info cache for port abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updated VIF entry in instance network info cache for port abf0a857-2db3-47b1-9c43-0fd0aa2e3e40. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [{"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be8bdcb1-fc62-46f4-831c-8544462aea9c req-d915fdd3-2a0d-4417-bd9a-1ebfa50f3724 service nova] Releasing lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:14 user nova-compute[76442]: INFO nova.virt.block_device [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Booting with volume d0b59af4-5483-4bba-af4f-0c8e3216222e at /dev/vdc
Nov 14 20:36:14 user nova-compute[76442]: DEBUG os_brick.utils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee17566-5d25-4398-86cd-184e4fa95afe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b357858e-b2a8-4607-bf2f-9ecf68d1409b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e56ea-00d5-4e16-9dd9-55d1730e5a6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[742e67b9-b35e-4b36-8260-3f251f566e4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:14 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:36:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c97a8e1-d1eb-4225-95a9-3faf8500f7f2]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG os_brick.utils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:14 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating existing volume attachment record: 205a91db-f777-450b-a4e2-28365ae1ae33 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:36:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:36:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Creating image(s)
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Ensure instance console log exists: /opt/stack/data/nova/instances/81e9fdfe-5853-4728-9618-d50ee80fa7fb/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Start _get_guest_xml network_info=[{"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymrZfbjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81e9fdfe-5853-4728-9618-d50ee80fa7fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe076475-7ca4-485f-b29e-911181ec6c42', 'serial': 'fe076475-7ca4-485f-b29e-911181ec6c42'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'bf201307-82bf-4f13-aec1-9cd3180ca313', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoFgkwVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81e9fdfe-5853-4728-9618-d50ee80fa7fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'dde8b95b-78dc-40c8-8db9-05da1b79d495', 'serial': 'dde8b95b-78dc-40c8-8db9-05da1b79d495'}, 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'attachment_id': 'a1715c29-ce67-4a7e-a061-a91f107e3cb7', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEMthuSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81e9fdfe-5853-4728-9618-d50ee80fa7fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0b59af4-5483-4bba-af4f-0c8e3216222e', 'serial': 'd0b59af4-5483-4bba-af4f-0c8e3216222e'}, 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'attachment_id': '205a91db-f777-450b-a4e2-28365ae1ae33', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:36:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:36:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG os_brick.initiator.connector [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Factory for ISCSI on None {{(pid=76442) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymrZfbjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:18 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:36:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:36:18 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:36:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:36:18 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cd6eba-54ea-424f-a394-7b6c3e26b9f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:36:18 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[946db86e-b3d0-4547-bd62-5305dca1d7e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42] added
Nov 14 20:36:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1a1ca4-37fd-4eac-b964-1853e53f60b3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8182f093-a0f6-4b14-bbf7-20e42c6a52f9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymrZfbjs {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ymrZfbjs" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7584cab3-e275-427e-89e6-eff0cacc0014]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ymrZfbjs'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c38c4cc-a01f-40d7-bdff-71e885a0b187]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6707b308-d538-4780-a3a2-0162e572cfe8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 20:36:19 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 20:36:19 user nova-compute[76442]:  {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:36:19 user nova-compute[76442]: WARNING os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 20:36:19 user nova-compute[76442]: 
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b4a709-21e3-4828-a901-baffd75d7ba0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42, portal: 172.16.0.220,3260]
Nov 14 20:36:19 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42, portal: 172.16.0.220,3260] successful.
Nov 14 20:36:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f046119b-cdeb-4034-8750-6910deeca5d1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e4353-86dc-484e-8aa8-1522fb66ff14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3f00fc-cb38-48dc-8d25-54255a138720]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:36:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymrZfbjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23036323731376364', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036323731376364', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoFgkwVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:20 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:36:20 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:36:20 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b154f32e-68cd-4f33-9c58-2a172c9c2b6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:36:20 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[814dbd8c-3ce6-4fce-a29a-f4e14bcba87d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495] added
Nov 14 20:36:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a963383-5b41-494b-beb9-ef5dfed3c51a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565f6b4-e8b8-42d1-9019-34268ed97463]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoFgkwVq {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoFgkwVq" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c2f68-1f0e-4548-86f5-40541cb30616]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BoFgkwVq'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f53445-11fd-4cd6-b9b0-691f16d9782e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2221e0b-64d3-489d-944f-c61da112b38c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5904e97-4da0-4a8e-aebd-c1389afaeacb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495, portal: 172.16.0.220,3260]
Nov 14 20:36:20 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495, portal: 172.16.0.220,3260] successful.
Nov 14 20:36:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd741d0-140c-4d28-87d9-8e1f59f6e1b9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d8e9a0-1f7f-4d5c-9def-8f3ce635a1a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:20 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:20 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef12cbc-b4b8-4ca0-bf4e-733101f7ce26]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoFgkwVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23039643063333035', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039643063333035', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEMthuSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:21 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:36:21 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:36:21 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b873995-fbe8-402f-81cb-25d256490e53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:36:21 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b70d735-9e6f-4187-8d81-b15c8928f903]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e] added
Nov 14 20:36:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0925197-3700-446d-b82e-1b7e4def06aa]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[45642d19-5fa6-4cdc-a26a-e21761a04a10]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PEMthuSp {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PEMthuSp" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45a3e06-5813-4120-964e-338a8c472d86]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PEMthuSp'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f3108d-79ce-4685-ac93-3f6a49facb86]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef519dba-3773-4c7c-9597-0bc4ae757982]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:21 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:21 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[335b471e-532f-4641-a548-370d81c127aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e, portal: 172.16.0.220,3260]
Nov 14 20:36:21 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e, portal: 172.16.0.220,3260] successful.
Nov 14 20:36:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d6be3-76d6-4ab3-b419-3c5c57a68c24]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f19a6cf-659d-4df1-8bd5-12c30bc64152]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:21 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:21 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:36:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:21 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:21 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:36:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e26c8a-a82e-47a2-a4ed-ca1a21f4a77c]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:21 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEMthuSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26138326636333064', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138326636333064', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:71:a2,bridge_name='br-int',has_traffic_filtering=True,id=30298928-9818-41f6-a56d-0a5b574e138f,network=Network(ab9db1cd-35ad-4b93-8f42-c5e7898d8748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30298928-98') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6f81cf9-1b2d-4626-9a1d-6799ecf54357,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f81cf9-1b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=3884676d-16e2-4ae9-ae67-f545426a2a28,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3884676d-16') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fe:bb,bridge_name='br-int',has_traffic_filtering=True,id=5480900f-7611-41fc-95d7-9ad901637d7a,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5480900f-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0e:87,bridge_name='br-int',has_traffic_filtering=True,id=ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec295d3b-5e') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:16:cc,bridge_name='br-int',has_traffic_filtering=True,id=e3916fc6-9f0b-4f37-bd71-9e809b1e72a3,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3916fc6-9f') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f5:64,bridge_name='br-int',has_traffic_filtering=True,id=abf0a857-2db3-47b1-9c43-0fd0aa2e3e40,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0a857-2d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.objects.instance [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lazy-loading 'pci_devices' on Instance uuid 81e9fdfe-5853-4728-9618-d50ee80fa7fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:36:22 user nova-compute[76442]:   <uuid>81e9fdfe-5853-4728-9618-d50ee80fa7fb</uuid>
Nov 14 20:36:22 user nova-compute[76442]:   <name>instance-0000000b</name>
Nov 14 20:36:22 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:36:22 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:36:22 user nova-compute[76442]:   <metadata>
Nov 14 20:36:22 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:36:22 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:36:22 user nova-compute[76442]:       <nova:name>tempest-device-tagging-server-882337732</nova:name>
Nov 14 20:36:22 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:36:18</nova:creationTime>
Nov 14 20:36:22 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:36:22 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:36:22 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:36:22 user nova-compute[76442]:       <nova:owner>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:user uuid="271920a06b1747949cea79a6e815098e">tempest-TaggedBootDevicesTest_v242-1104592603-project-member</nova:user>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:project uuid="dccb4e840f4141baab5c71494e39ece0">tempest-TaggedBootDevicesTest_v242-1104592603</nova:project>
Nov 14 20:36:22 user nova-compute[76442]:       </nova:owner>
Nov 14 20:36:22 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:36:22 user nova-compute[76442]:       <nova:ports>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:port uuid="30298928-9818-41f6-a56d-0a5b574e138f">
Nov 14 20:36:22 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 20:36:22 user nova-compute[76442]:         </nova:port>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:port uuid="b6f81cf9-1b2d-4626-9a1d-6799ecf54357">
Nov 14 20:36:22 user nova-compute[76442]:           <nova:ip type="fixed" address="10.1.1.123" ipVersion="4"/>
Nov 14 20:36:22 user nova-compute[76442]:         </nova:port>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:port uuid="3884676d-16e2-4ae9-ae67-f545426a2a28">
Nov 14 20:36:22 user nova-compute[76442]:           <nova:ip type="fixed" address="10.1.1.84" ipVersion="4"/>
Nov 14 20:36:22 user nova-compute[76442]:         </nova:port>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:port uuid="5480900f-7611-41fc-95d7-9ad901637d7a">
Nov 14 20:36:22 user nova-compute[76442]:           <nova:ip type="fixed" address="10.1.1.64" ipVersion="4"/>
Nov 14 20:36:22 user nova-compute[76442]:         </nova:port>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:port uuid="ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd">
Nov 14 20:36:22 user nova-compute[76442]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Nov 14 20:36:22 user nova-compute[76442]:         </nova:port>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:port uuid="e3916fc6-9f0b-4f37-bd71-9e809b1e72a3">
Nov 14 20:36:22 user nova-compute[76442]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 20:36:22 user nova-compute[76442]:         </nova:port>
Nov 14 20:36:22 user nova-compute[76442]:         <nova:port uuid="abf0a857-2db3-47b1-9c43-0fd0aa2e3e40">
Nov 14 20:36:22 user nova-compute[76442]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 20:36:22 user nova-compute[76442]:         </nova:port>
Nov 14 20:36:22 user nova-compute[76442]:       </nova:ports>
Nov 14 20:36:22 user nova-compute[76442]:     </nova:instance>
Nov 14 20:36:22 user nova-compute[76442]:   </metadata>
Nov 14 20:36:22 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:36:22 user nova-compute[76442]:     <system>
Nov 14 20:36:22 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:36:22 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:36:22 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:36:22 user nova-compute[76442]:       <entry name="serial">81e9fdfe-5853-4728-9618-d50ee80fa7fb</entry>
Nov 14 20:36:22 user nova-compute[76442]:       <entry name="uuid">81e9fdfe-5853-4728-9618-d50ee80fa7fb</entry>
Nov 14 20:36:22 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:36:22 user nova-compute[76442]:     </system>
Nov 14 20:36:22 user nova-compute[76442]:   </sysinfo>
Nov 14 20:36:22 user nova-compute[76442]:   <os>
Nov 14 20:36:22 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:36:22 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:36:22 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:36:22 user nova-compute[76442]:   </os>
Nov 14 20:36:22 user nova-compute[76442]:   <features>
Nov 14 20:36:22 user nova-compute[76442]:     <acpi/>
Nov 14 20:36:22 user nova-compute[76442]:     <apic/>
Nov 14 20:36:22 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:36:22 user nova-compute[76442]:   </features>
Nov 14 20:36:22 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:36:22 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:36:22 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:36:22 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:36:22 user nova-compute[76442]:   </clock>
Nov 14 20:36:22 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:36:22 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:36:22 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:36:22 user nova-compute[76442]:   </cpu>
Nov 14 20:36:22 user nova-compute[76442]:   <devices>
Nov 14 20:36:22 user nova-compute[76442]:     <disk type="file" device="cdrom">
Nov 14 20:36:22 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 20:36:22 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/81e9fdfe-5853-4728-9618-d50ee80fa7fb/disk.config"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="hda" bus="ide"/>
Nov 14 20:36:22 user nova-compute[76442]:     </disk>
Nov 14 20:36:22 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:36:22 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:36:22 user nova-compute[76442]:       <source dev="/dev/sdb"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <serial>fe076475-7ca4-485f-b29e-911181ec6c42</serial>
Nov 14 20:36:22 user nova-compute[76442]:     </disk>
Nov 14 20:36:22 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:36:22 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:36:22 user nova-compute[76442]:       <source dev="/dev/sdc"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <serial>dde8b95b-78dc-40c8-8db9-05da1b79d495</serial>
Nov 14 20:36:22 user nova-compute[76442]:     </disk>
Nov 14 20:36:22 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:36:22 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:36:22 user nova-compute[76442]:       <source dev="/dev/sdd"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="vdc" bus="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <serial>d0b59af4-5483-4bba-af4f-0c8e3216222e</serial>
Nov 14 20:36:22 user nova-compute[76442]:     </disk>
Nov 14 20:36:22 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:36:22 user nova-compute[76442]:       <mac address="fa:16:3e:5c:71:a2"/>
Nov 14 20:36:22 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="tap30298928-98"/>
Nov 14 20:36:22 user nova-compute[76442]:     </interface>
Nov 14 20:36:22 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:36:22 user nova-compute[76442]:       <mac address="fa:16:3e:85:4e:8c"/>
Nov 14 20:36:22 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="tapb6f81cf9-1b"/>
Nov 14 20:36:22 user nova-compute[76442]:     </interface>
Nov 14 20:36:22 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:36:22 user nova-compute[76442]:       <mac address="fa:16:3e:cd:af:8a"/>
Nov 14 20:36:22 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="tap3884676d-16"/>
Nov 14 20:36:22 user nova-compute[76442]:     </interface>
Nov 14 20:36:22 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:36:22 user nova-compute[76442]:       <mac address="fa:16:3e:5a:fe:bb"/>
Nov 14 20:36:22 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="tap5480900f-76"/>
Nov 14 20:36:22 user nova-compute[76442]:     </interface>
Nov 14 20:36:22 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:36:22 user nova-compute[76442]:       <mac address="fa:16:3e:7e:0e:87"/>
Nov 14 20:36:22 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="tapec295d3b-5e"/>
Nov 14 20:36:22 user nova-compute[76442]:     </interface>
Nov 14 20:36:22 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:36:22 user nova-compute[76442]:       <mac address="fa:16:3e:4d:16:cc"/>
Nov 14 20:36:22 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="tape3916fc6-9f"/>
Nov 14 20:36:22 user nova-compute[76442]:     </interface>
Nov 14 20:36:22 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:36:22 user nova-compute[76442]:       <mac address="fa:16:3e:56:f5:64"/>
Nov 14 20:36:22 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:36:22 user nova-compute[76442]:       <target dev="tapabf0a857-2d"/>
Nov 14 20:36:22 user nova-compute[76442]:     </interface>
Nov 14 20:36:22 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:36:22 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/81e9fdfe-5853-4728-9618-d50ee80fa7fb/console.log" append="off"/>
Nov 14 20:36:22 user nova-compute[76442]:     </serial>
Nov 14 20:36:22 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:36:22 user nova-compute[76442]:     <video>
Nov 14 20:36:22 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:36:22 user nova-compute[76442]:     </video>
Nov 14 20:36:22 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:36:22 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:36:22 user nova-compute[76442]:     </rng>
Nov 14 20:36:22 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:36:22 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:36:22 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:36:22 user nova-compute[76442]:     </memballoon>
Nov 14 20:36:22 user nova-compute[76442]:   </devices>
Nov 14 20:36:22 user nova-compute[76442]: </domain>
Nov 14 20:36:22 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:71:a2,bridge_name='br-int',has_traffic_filtering=True,id=30298928-9818-41f6-a56d-0a5b574e138f,network=Network(ab9db1cd-35ad-4b93-8f42-c5e7898d8748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30298928-98') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:71:a2,bridge_name='br-int',has_traffic_filtering=True,id=30298928-9818-41f6-a56d-0a5b574e138f,network=Network(ab9db1cd-35ad-4b93-8f42-c5e7898d8748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30298928-98') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9cecb7f-9508-53ea-8043-887bad392951', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30298928-98, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30298928-98, col_values=(('qos', UUID('bc013667-fd9c-4044-8432-4b10de5b88a3')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30298928-98, col_values=(('external_ids', {'iface-id': '30298928-9818-41f6-a56d-0a5b574e138f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:71:a2', 'vm-uuid': '81e9fdfe-5853-4728-9618-d50ee80fa7fb'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: INFO os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:71:a2,bridge_name='br-int',has_traffic_filtering=True,id=30298928-9818-41f6-a56d-0a5b574e138f,network=Network(ab9db1cd-35ad-4b93-8f42-c5e7898d8748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30298928-98')
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6f81cf9-1b2d-4626-9a1d-6799ecf54357,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f81cf9-1b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6f81cf9-1b2d-4626-9a1d-6799ecf54357,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f81cf9-1b') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a423c90f-93ae-5010-ad90-00dd999f1390', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6f81cf9-1b, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6f81cf9-1b, col_values=(('qos', UUID('ed569dcd-5289-441f-9b0f-c0b4444697f4')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6f81cf9-1b, col_values=(('external_ids', {'iface-id': 'b6f81cf9-1b2d-4626-9a1d-6799ecf54357', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:4e:8c', 'vm-uuid': '81e9fdfe-5853-4728-9618-d50ee80fa7fb'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: INFO os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6f81cf9-1b2d-4626-9a1d-6799ecf54357,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f81cf9-1b')
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=3884676d-16e2-4ae9-ae67-f545426a2a28,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3884676d-16') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=3884676d-16e2-4ae9-ae67-f545426a2a28,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3884676d-16') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '428cbd4c-fb61-5ad3-9c93-62c6e2eb3e71', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3884676d-16, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3884676d-16, col_values=(('qos', UUID('8df933d2-3b95-4414-8c1a-162c89c47f21')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3884676d-16, col_values=(('external_ids', {'iface-id': '3884676d-16e2-4ae9-ae67-f545426a2a28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:af:8a', 'vm-uuid': '81e9fdfe-5853-4728-9618-d50ee80fa7fb'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: INFO os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=3884676d-16e2-4ae9-ae67-f545426a2a28,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3884676d-16')
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fe:bb,bridge_name='br-int',has_traffic_filtering=True,id=5480900f-7611-41fc-95d7-9ad901637d7a,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5480900f-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fe:bb,bridge_name='br-int',has_traffic_filtering=True,id=5480900f-7611-41fc-95d7-9ad901637d7a,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5480900f-76') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da5a6ae6-bde7-54b5-a490-06961360daed', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5480900f-76, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5480900f-76, col_values=(('qos', UUID('055fdb29-e544-4faa-b8ad-7f12d3092bd8')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5480900f-76, col_values=(('external_ids', {'iface-id': '5480900f-7611-41fc-95d7-9ad901637d7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:fe:bb', 'vm-uuid': '81e9fdfe-5853-4728-9618-d50ee80fa7fb'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: INFO os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fe:bb,bridge_name='br-int',has_traffic_filtering=True,id=5480900f-7611-41fc-95d7-9ad901637d7a,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5480900f-76')
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0e:87,bridge_name='br-int',has_traffic_filtering=True,id=ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec295d3b-5e') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0e:87,bridge_name='br-int',has_traffic_filtering=True,id=ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec295d3b-5e') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4330d7a-5a21-5aa6-847c-56f515174324', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec295d3b-5e, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec295d3b-5e, col_values=(('qos', UUID('6a927b96-7bcf-402c-aa9c-571d70ac2cb9')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec295d3b-5e, col_values=(('external_ids', {'iface-id': 'ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:0e:87', 'vm-uuid': '81e9fdfe-5853-4728-9618-d50ee80fa7fb'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: INFO os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0e:87,bridge_name='br-int',has_traffic_filtering=True,id=ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec295d3b-5e')
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:16:cc,bridge_name='br-int',has_traffic_filtering=True,id=e3916fc6-9f0b-4f37-bd71-9e809b1e72a3,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3916fc6-9f') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:16:cc,bridge_name='br-int',has_traffic_filtering=True,id=e3916fc6-9f0b-4f37-bd71-9e809b1e72a3,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3916fc6-9f') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a850b8f2-3655-581b-b89b-a1f95a0ee2e0', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3916fc6-9f, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3916fc6-9f, col_values=(('qos', UUID('3c05aa4d-c266-45be-9769-261f52b4b15a')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3916fc6-9f, col_values=(('external_ids', {'iface-id': 'e3916fc6-9f0b-4f37-bd71-9e809b1e72a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:16:cc', 'vm-uuid': '81e9fdfe-5853-4728-9618-d50ee80fa7fb'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: INFO os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:16:cc,bridge_name='br-int',has_traffic_filtering=True,id=e3916fc6-9f0b-4f37-bd71-9e809b1e72a3,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3916fc6-9f')
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f5:64,bridge_name='br-int',has_traffic_filtering=True,id=abf0a857-2db3-47b1-9c43-0fd0aa2e3e40,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0a857-2d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f5:64,bridge_name='br-int',has_traffic_filtering=True,id=abf0a857-2db3-47b1-9c43-0fd0aa2e3e40,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0a857-2d') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb01cbeb-ea82-53ba-81cb-037e7d6f48fc', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabf0a857-2d, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabf0a857-2d, col_values=(('qos', UUID('072af9da-446d-4b0c-a145-b68d42a8e0dc')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabf0a857-2d, col_values=(('external_ids', {'iface-id': 'abf0a857-2db3-47b1-9c43-0fd0aa2e3e40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:f5:64', 'vm-uuid': '81e9fdfe-5853-4728-9618-d50ee80fa7fb'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:23 user nova-compute[76442]: INFO os_vif [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f5:64,bridge_name='br-int',has_traffic_filtering=True,id=abf0a857-2db3-47b1-9c43-0fd0aa2e3e40,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0a857-2d')
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] No BDM found with device name hda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] No VIF found with MAC fa:16:3e:5c:71:a2, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] No VIF found with MAC fa:16:3e:7e:0e:87, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:36:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Using config drive
Nov 14 20:36:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Creating config drive at /opt/stack/data/nova/instances/81e9fdfe-5853-4728-9618-d50ee80fa7fb/disk.config
Nov 14 20:36:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81e9fdfe-5853-4728-9618-d50ee80fa7fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyk7g0zy6 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81e9fdfe-5853-4728-9618-d50ee80fa7fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyk7g0zy6" returned: 0 in 0.051s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-c58f9b1c-717d-444c-aa22-77b93fbfa516 req-7b86113d-57ba-4d34-9d03-2a84a4bf12f0 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c58f9b1c-717d-444c-aa22-77b93fbfa516 req-7b86113d-57ba-4d34-9d03-2a84a4bf12f0 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c58f9b1c-717d-444c-aa22-77b93fbfa516 req-7b86113d-57ba-4d34-9d03-2a84a4bf12f0 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c58f9b1c-717d-444c-aa22-77b93fbfa516 req-7b86113d-57ba-4d34-9d03-2a84a4bf12f0 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-c58f9b1c-717d-444c-aa22-77b93fbfa516 req-7b86113d-57ba-4d34-9d03-2a84a4bf12f0 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:25 user nova-compute[76442]: WARNING nova.compute.manager [req-c58f9b1c-717d-444c-aa22-77b93fbfa516 req-7b86113d-57ba-4d34-9d03-2a84a4bf12f0 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-30298928-9818-41f6-a56d-0a5b574e138f for instance with vm_state building and task_state spawning.
Nov 14 20:36:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-ce228a30-61d9-4590-9640-f3dc49304944 req-c7b023ca-f4cb-40f9-b5c0-9782ec72f5df service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ce228a30-61d9-4590-9640-f3dc49304944 req-c7b023ca-f4cb-40f9-b5c0-9782ec72f5df service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ce228a30-61d9-4590-9640-f3dc49304944 req-c7b023ca-f4cb-40f9-b5c0-9782ec72f5df service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ce228a30-61d9-4590-9640-f3dc49304944 req-c7b023ca-f4cb-40f9-b5c0-9782ec72f5df service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-ce228a30-61d9-4590-9640-f3dc49304944 req-c7b023ca-f4cb-40f9-b5c0-9782ec72f5df service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:26 user nova-compute[76442]: WARNING nova.compute.manager [req-ce228a30-61d9-4590-9640-f3dc49304944 req-c7b023ca-f4cb-40f9-b5c0-9782ec72f5df service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-3884676d-16e2-4ae9-ae67-f545426a2a28 for instance with vm_state building and task_state spawning.
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-488ed22f-ad33-4bc3-9c53-ccaf3f40c3e5 req-4f99d04c-72be-4e2d-b76d-9d3e8f7ce088 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-488ed22f-ad33-4bc3-9c53-ccaf3f40c3e5 req-4f99d04c-72be-4e2d-b76d-9d3e8f7ce088 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-488ed22f-ad33-4bc3-9c53-ccaf3f40c3e5 req-4f99d04c-72be-4e2d-b76d-9d3e8f7ce088 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-488ed22f-ad33-4bc3-9c53-ccaf3f40c3e5 req-4f99d04c-72be-4e2d-b76d-9d3e8f7ce088 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-488ed22f-ad33-4bc3-9c53-ccaf3f40c3e5 req-4f99d04c-72be-4e2d-b76d-9d3e8f7ce088 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:27 user nova-compute[76442]: WARNING nova.compute.manager [req-488ed22f-ad33-4bc3-9c53-ccaf3f40c3e5 req-4f99d04c-72be-4e2d-b76d-9d3e8f7ce088 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 for instance with vm_state building and task_state spawning.
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:27 user nova-compute[76442]: WARNING nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-30298928-9818-41f6-a56d-0a5b574e138f for instance with vm_state building and task_state spawning.
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:27 user nova-compute[76442]: WARNING nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 for instance with vm_state building and task_state spawning.
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:27 user nova-compute[76442]: WARNING nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 for instance with vm_state building and task_state spawning.
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:27 user nova-compute[76442]: WARNING nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-5480900f-7611-41fc-95d7-9ad901637d7a for instance with vm_state building and task_state spawning.
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:27 user nova-compute[76442]: WARNING nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-5480900f-7611-41fc-95d7-9ad901637d7a for instance with vm_state building and task_state spawning.
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:27 user nova-compute[76442]: WARNING nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 for instance with vm_state building and task_state spawning.
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:27 user nova-compute[76442]: WARNING nova.compute.manager [req-76123106-0dd2-4251-9799-0c1409ea7468 req-bfd650b4-6564-4385-bf88-7f1c2c020c68 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 for instance with vm_state building and task_state spawning.
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:28 user nova-compute[76442]: WARNING nova.compute.manager [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-3884676d-16e2-4ae9-ae67-f545426a2a28 for instance with vm_state building and task_state spawning.
Nov 14 20:36:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:28 user nova-compute[76442]: WARNING nova.compute.manager [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd for instance with vm_state building and task_state spawning.
Nov 14 20:36:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:28 user nova-compute[76442]: WARNING nova.compute.manager [req-cc11a0bc-ca32-4fb9-a97a-8a90d8892673 req-6bed73fa-e00a-475e-a19e-617038fc8c1a service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd for instance with vm_state building and task_state spawning.
Nov 14 20:36:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:36:29 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Instance spawned successfully.
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-9b0ff456-ff6f-42f6-91ef-364adc0347dd req-8a7bb48f-358c-47d8-9d58-679c684a9a39 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9b0ff456-ff6f-42f6-91ef-364adc0347dd req-8a7bb48f-358c-47d8-9d58-679c684a9a39 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9b0ff456-ff6f-42f6-91ef-364adc0347dd req-8a7bb48f-358c-47d8-9d58-679c684a9a39 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9b0ff456-ff6f-42f6-91ef-364adc0347dd req-8a7bb48f-358c-47d8-9d58-679c684a9a39 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-9b0ff456-ff6f-42f6-91ef-364adc0347dd req-8a7bb48f-358c-47d8-9d58-679c684a9a39 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:29 user nova-compute[76442]: WARNING nova.compute.manager [req-9b0ff456-ff6f-42f6-91ef-364adc0347dd req-8a7bb48f-358c-47d8-9d58-679c684a9a39 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 for instance with vm_state building and task_state spawning.
Nov 14 20:36:29 user nova-compute[76442]: INFO nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Took 10.62 seconds to spawn the instance on the hypervisor.
Nov 14 20:36:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:36:29 user nova-compute[76442]: INFO nova.compute.manager [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Took 27.56 seconds to build instance.
Nov 14 20:36:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-08194a5c-43c1-418f-8b86-efb38f81f752 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.651s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:36:43 user nova-compute[76442]: INFO nova.compute.manager [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] instance snapshotting
Nov 14 20:36:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Beginning live snapshot process
Nov 14 20:36:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json -f qcow2 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json -f qcow2 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdvf2kjxf/87d3b1fb4fa942abbcdafe682a370e2f.delta 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdvf2kjxf/87d3b1fb4fa942abbcdafe682a370e2f.delta 1073741824" returned: 0 in 0.051s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 20:36:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Checking UEFI support for host arch (x86_64) {{(pid=76442) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 20:36:43 user nova-compute[76442]: INFO nova.virt.libvirt.host [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] UEFI support detected
Nov 14 20:36:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:36:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:36:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 20:36:45 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:36:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdvf2kjxf/87d3b1fb4fa942abbcdafe682a370e2f.delta /opt/stack/data/nova/instances/snapshots/tmpdvf2kjxf/87d3b1fb4fa942abbcdafe682a370e2f {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdvf2kjxf/87d3b1fb4fa942abbcdafe682a370e2f.delta /opt/stack/data/nova/instances/snapshots/tmpdvf2kjxf/87d3b1fb4fa942abbcdafe682a370e2f" returned: 0 in 1.004s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Snapshot extracted, beginning image upload
Nov 14 20:36:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Snapshot image upload complete
Nov 14 20:36:48 user nova-compute[76442]: INFO nova.compute.manager [None req-7e57db62-f87e-4b95-8802-82fa5a4f0762 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Took 5.76 seconds to snapshot the instance on the hypervisor.
Nov 14 20:36:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "15e2beda-544e-419b-b345-99f439670e0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lazy-loading 'flavor' on Instance uuid 15e2beda-544e-419b-b345-99f439670e0c {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "15e2beda-544e-419b-b345-99f439670e0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:51 user nova-compute[76442]: INFO nova.compute.manager [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Attaching volume b7f4375d-0370-4288-837a-a41542a539da to /dev/vdb
Nov 14 20:36:51 user nova-compute[76442]: DEBUG os_brick.utils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef736fb-ad6c-45bf-8347-4d61ea8b9b88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19df259-756b-450f-a66a-870fa71f3771]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e33f3d9-24a1-48a1-aa08-66d38b7f1027]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8ed746-d72b-44f6-b53e-ed4d3b2f3456]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:51 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:36:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d624c3f-1e88-45fa-858d-3ba1285f8977]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG os_brick.utils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:51 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Updating existing volume attachment record: 1d742354-a4fb-47b9-8911-dbedae5ff9e0 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:36:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-143d713c-2934-4af9-828d-b983fe5edbd2 req-fe5bec12-0a75-4d43-986c-825a91aefcf6 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received event network-changed-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-143d713c-2934-4af9-828d-b983fe5edbd2 req-fe5bec12-0a75-4d43-986c-825a91aefcf6 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Refreshing instance network info cache due to event network-changed-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-143d713c-2934-4af9-828d-b983fe5edbd2 req-fe5bec12-0a75-4d43-986c-825a91aefcf6 service nova] Acquiring lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-143d713c-2934-4af9-828d-b983fe5edbd2 req-fe5bec12-0a75-4d43-986c-825a91aefcf6 service nova] Acquired lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-143d713c-2934-4af9-828d-b983fe5edbd2 req-fe5bec12-0a75-4d43-986c-825a91aefcf6 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Refreshing network info cache for port 9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-143d713c-2934-4af9-828d-b983fe5edbd2 req-fe5bec12-0a75-4d43-986c-825a91aefcf6 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Updated VIF entry in instance network info cache for port 9257e17c-00d0-4a97-ace5-2d7ce1ba60c4. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:36:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-143d713c-2934-4af9-828d-b983fe5edbd2 req-fe5bec12-0a75-4d43-986c-825a91aefcf6 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Updating instance_info_cache with network_info: [{"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-143d713c-2934-4af9-828d-b983fe5edbd2 req-fe5bec12-0a75-4d43-986c-825a91aefcf6 service nova] Releasing lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:36:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDyUzlEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:56 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:36:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:36:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:36:56 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:36:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:36:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:36:56 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:36:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad23153-ffb4-4545-8378-2c12d99d7b7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:36:57 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7c0531-210e-496b-ad98-37247f58173a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da] added
Nov 14 20:36:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c182c703-bd74-4b41-bfdb-0e4c3ab69ed9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7cb227-2c0f-44c2-8b59-4f9eccb693dc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDyUzlEP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDyUzlEP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bce67a-6c1f-4135-9f5d-e1d0c2b46af4]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDyUzlEP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[280d2600-d726-4b73-92bd-38c6dfda198a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c962e21-6ad3-448a-86d6-ee62a8160843]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:36:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:36:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07bffb0-6dee-45e8-a8f4-c2edad5c70ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da, portal: 172.16.0.220,3260]
Nov 14 20:36:57 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da, portal: 172.16.0.220,3260] successful.
Nov 14 20:36:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5506065e-a289-46ad-b2d0-8aaa2b39eac1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a028f-b533-4910-88c7-c39d389ecce2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da (non-flash)
Nov 14 20:36:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:36:57 user nova-compute[76442]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da (non-flash)
Nov 14 20:36:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[08726f1c-5663-4093-b27b-0c117c1e59d9]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.objects.instance [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'flavor' on Instance uuid da018992-79f4-4db3-bbf7-a492508ff629 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:57 user nova-compute[76442]: INFO nova.compute.manager [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Attaching volume c0c6480a-cde4-4f36-a8da-55c28f18198b to /dev/vdb
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.utils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46bd4ad-8628-4768-87c9-59389a2d482d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3877e1fc-6d5e-4cb2-955c-b015d4bff621]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-0e3c5566-a3c3-4a15-9b02-9b3dfd0aa73e req-d3e7b78a-9a49-47a6-b586-b0b8bf05ec74 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-changed-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-0e3c5566-a3c3-4a15-9b02-9b3dfd0aa73e req-d3e7b78a-9a49-47a6-b586-b0b8bf05ec74 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Refreshing instance network info cache due to event network-changed-efe55142-461c-40ce-a422-d396af94b09d. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e3c5566-a3c3-4a15-9b02-9b3dfd0aa73e req-d3e7b78a-9a49-47a6-b586-b0b8bf05ec74 service nova] Acquiring lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e3c5566-a3c3-4a15-9b02-9b3dfd0aa73e req-d3e7b78a-9a49-47a6-b586-b0b8bf05ec74 service nova] Acquired lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-0e3c5566-a3c3-4a15-9b02-9b3dfd0aa73e req-d3e7b78a-9a49-47a6-b586-b0b8bf05ec74 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Refreshing network info cache for port efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb89a7e6-6c4e-4173-a034-3eff068629b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0ea3da-dc2c-442d-b5bc-56791e3fb0ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:57 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c596cb-219b-4e03-abd4-5a216c86a496]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG os_brick.utils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Updating existing volume attachment record: 49b0e8cd-b42c-44d1-b07d-97f83c4b18ca {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-15e2beda-544e-419b-b345-99f439670e0c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-15e2beda-544e-419b-b345-99f439670e0c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-d3302af4-4a1a-43e7-af17-7e87b116199b req-e7cab1ca-03c6-4e74-8135-1a2ae2eabcda service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-changed-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-d3302af4-4a1a-43e7-af17-7e87b116199b req-e7cab1ca-03c6-4e74-8135-1a2ae2eabcda service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Refreshing instance network info cache due to event network-changed-c58581ff-741a-45f7-a75f-11a6a5ee71ce. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d3302af4-4a1a-43e7-af17-7e87b116199b req-e7cab1ca-03c6-4e74-8135-1a2ae2eabcda service nova] Acquiring lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d3302af4-4a1a-43e7-af17-7e87b116199b req-e7cab1ca-03c6-4e74-8135-1a2ae2eabcda service nova] Acquired lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:36:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-d3302af4-4a1a-43e7-af17-7e87b116199b req-e7cab1ca-03c6-4e74-8135-1a2ae2eabcda service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Refreshing network info cache for port c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-0e3c5566-a3c3-4a15-9b02-9b3dfd0aa73e req-d3e7b78a-9a49-47a6-b586-b0b8bf05ec74 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updated VIF entry in instance network info cache for port efe55142-461c-40ce-a422-d396af94b09d. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-0e3c5566-a3c3-4a15-9b02-9b3dfd0aa73e req-d3e7b78a-9a49-47a6-b586-b0b8bf05ec74 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating instance_info_cache with network_info: [{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e3c5566-a3c3-4a15-9b02-9b3dfd0aa73e req-d3e7b78a-9a49-47a6-b586-b0b8bf05ec74 service nova] Releasing lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDyUzlEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26562386434663561', 'path': '/dev/sde'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562386434663561', 'path': '/dev/sde'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lazy-loading 'flavor' on Instance uuid 15e2beda-544e-419b-b345-99f439670e0c {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Updating instance_info_cache with network_info: [{"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:36:58 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:36:58 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:36:58 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:36:58 user nova-compute[76442]:   <serial>b7f4375d-0370-4288-837a-a41542a539da</serial>
Nov 14 20:36:58 user nova-compute[76442]: </disk>
Nov 14 20:36:58 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-15e2beda-544e-419b-b345-99f439670e0c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-d3302af4-4a1a-43e7-af17-7e87b116199b req-e7cab1ca-03c6-4e74-8135-1a2ae2eabcda service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updated VIF entry in instance network info cache for port c58581ff-741a-45f7-a75f-11a6a5ee71ce. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-d3302af4-4a1a-43e7-af17-7e87b116199b req-e7cab1ca-03c6-4e74-8135-1a2ae2eabcda service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating instance_info_cache with network_info: [{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d3302af4-4a1a-43e7-af17-7e87b116199b req-e7cab1ca-03c6-4e74-8135-1a2ae2eabcda service nova] Releasing lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] No VIF found with MAC fa:16:3e:c4:d1:e2, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f558a27-489e-42f3-bd8b-a02669c5bb38 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.183s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.objects.instance [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:36:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:59 user nova-compute[76442]: INFO nova.compute.manager [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] instance snapshotting
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Beginning live snapshot process
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:59 user nova-compute[76442]: INFO nova.compute.manager [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Attaching volume 94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 to /dev/vdb
Nov 14 20:36:59 user nova-compute[76442]: DEBUG os_brick.utils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9076dc-19d6-468c-8d5b-c64d2d1dad55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b8b7f6-5aba-46dd-90f9-9de0bd250d2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26d60ae-5bfe-431b-a622-9ebd2652f5f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2fc156-558a-42db-97ec-16f2a051c000]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json -f qcow2 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:36:59 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0ef948-e770-443a-bdd5-f9f9fe592407]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG os_brick.utils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating existing volume attachment record: 6585ad3a-5040-4e7e-9245-3a99f64b818d {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "15e2beda-544e-419b-b345-99f439670e0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "15e2beda-544e-419b-b345-99f439670e0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:59 user nova-compute[76442]: INFO nova.compute.manager [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Terminating instance
Nov 14 20:36:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json -f qcow2" returned: 0 in 0.221s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json -f qcow2 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-54fcac35-f2bc-4de8-8317-8009fc8d84a3 req-9ea3c9ad-c9dc-4031-ab53-b723c9fbe0b2 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received event network-vif-unplugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-54fcac35-f2bc-4de8-8317-8009fc8d84a3 req-9ea3c9ad-c9dc-4031-ab53-b723c9fbe0b2 service nova] Acquiring lock "15e2beda-544e-419b-b345-99f439670e0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-54fcac35-f2bc-4de8-8317-8009fc8d84a3 req-9ea3c9ad-c9dc-4031-ab53-b723c9fbe0b2 service nova] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-54fcac35-f2bc-4de8-8317-8009fc8d84a3 req-9ea3c9ad-c9dc-4031-ab53-b723c9fbe0b2 service nova] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-54fcac35-f2bc-4de8-8317-8009fc8d84a3 req-9ea3c9ad-c9dc-4031-ab53-b723c9fbe0b2 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] No waiting events found dispatching network-vif-unplugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-54fcac35-f2bc-4de8-8317-8009fc8d84a3 req-9ea3c9ad-c9dc-4031-ab53-b723c9fbe0b2 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received event network-vif-unplugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:36:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk958phk9/47bb985c09a841d794c37ac33957d5a5.delta 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk958phk9/47bb985c09a841d794c37ac33957d5a5.delta 1073741824" returned: 0 in 0.051s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:00 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:00 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Instance destroyed successfully.
Nov 14 20:37:00 user nova-compute[76442]: DEBUG nova.objects.instance [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lazy-loading 'resources' on Instance uuid 15e2beda-544e-419b-b345-99f439670e0c {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1074143063',display_name='tempest-DeleteServersTestJSON-server-1074143063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1074143063',id=2,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd8b97ba534f4544b0aa7d2fce1a97cc',ramdisk_id='',reservation_id='r-bloi8vtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-968047679',owner_user_name='tempest-DeleteServersTestJSON-968047679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:11Z,user_data=None,user_id='0b31c6c6a4eb4237a2ed349b300573b9',uuid=15e2beda-544e-419b-b345-99f439670e0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Converting VIF {"id": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "address": "fa:16:3e:c4:d1:e2", "network": {"id": "c7e653bb-fc43-46e1-9b67-d7fd3f1400f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-581790507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b97ba534f4544b0aa7d2fce1a97cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62c9899e-37", "ovs_interfaceid": "62c9899e-37d0-44cd-b4c8-0b6edb19133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d1:e2,bridge_name='br-int',has_traffic_filtering=True,id=62c9899e-37d0-44cd-b4c8-0b6edb19133c,network=Network(c7e653bb-fc43-46e1-9b67-d7fd3f1400f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c9899e-37') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG os_vif [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d1:e2,bridge_name='br-int',has_traffic_filtering=True,id=62c9899e-37d0-44cd-b4c8-0b6edb19133c,network=Network(c7e653bb-fc43-46e1-9b67-d7fd3f1400f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c9899e-37') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62c9899e-37, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d68f6a5-3cc1-434f-8240-e70b81bd8971) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:00 user nova-compute[76442]: INFO os_vif [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:d1:e2,bridge_name='br-int',has_traffic_filtering=True,id=62c9899e-37d0-44cd-b4c8-0b6edb19133c,network=Network(c7e653bb-fc43-46e1-9b67-d7fd3f1400f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62c9899e-37')
Nov 14 20:37:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDyUzlEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:00 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5d21d3-cc0b-4658-8a46-bf7a57ebdb3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:37:01 user nova-compute[76442]: No targets found.
Nov 14 20:37:01 user nova-compute[76442]: iSNS:
Nov 14 20:37:01 user nova-compute[76442]: No targets found.
Nov 14 20:37:01 user nova-compute[76442]: STATIC:
Nov 14 20:37:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e
Nov 14 20:37:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da
Nov 14 20:37:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495
Nov 14 20:37:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42
Nov 14 20:37:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:01 user nova-compute[76442]: FIRMWARE:
Nov 14 20:37:01 user nova-compute[76442]: No targets found.
Nov 14 20:37:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:37:01 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:37:01 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae32e3f-039a-4f3c-9e3f-629ebaae4e90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ead64e-79cc-425b-9c19-26f0beb053fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:01 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:01 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:01 user nova-compute[76442]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da (non-flash)
Nov 14 20:37:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:01 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:01 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:01 user nova-compute[76442]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da (non-flash)
Nov 14 20:37:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e84e7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da'): ({'sde'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Removing single pathed devices sde {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6328f1c-ba48-438e-84a4-0899d7ada9ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e177c51-7a01-4965-b230-57f2bbf0883e]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Flushing IO for device /dev/sde {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad5e150-b518-42e1-ab35-8448bdabe6b3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eea65a-4e64-4bcd-8007-f90c183e4cb6]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[23275932-218a-4d9d-a58b-4fd829856c93]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e07ba5f-fdac-4de7-94ce-3606beb62d3b]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da, portal: 172.16.0.220,3260]
Nov 14 20:37:01 user nova-compute[76442]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f4375d-0370-4288-837a-a41542a539da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[67634010-a8b0-46e4-890e-bf4bd347c65d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] <== disconnect_volume: return (407ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:37:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Deleting instance files /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c_del
Nov 14 20:37:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Deletion of /opt/stack/data/nova/instances/15e2beda-544e-419b-b345-99f439670e0c_del complete
Nov 14 20:37:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 20:37:01 user nova-compute[76442]: INFO nova.compute.manager [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Took 1.94 seconds to destroy the instance on the hypervisor.
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 15e2beda-544e-419b-b345-99f439670e0c] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk958phk9/47bb985c09a841d794c37ac33957d5a5.delta /opt/stack/data/nova/instances/snapshots/tmpk958phk9/47bb985c09a841d794c37ac33957d5a5 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk958phk9/47bb985c09a841d794c37ac33957d5a5.delta /opt/stack/data/nova/instances/snapshots/tmpk958phk9/47bb985c09a841d794c37ac33957d5a5" returned: 0 in 0.341s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-e468c598-f03b-4ade-98e4-115d3a046c25 req-2e078de6-71e2-4eb0-8112-376831f23372 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received event network-vif-plugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e468c598-f03b-4ade-98e4-115d3a046c25 req-2e078de6-71e2-4eb0-8112-376831f23372 service nova] Acquiring lock "15e2beda-544e-419b-b345-99f439670e0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e468c598-f03b-4ade-98e4-115d3a046c25 req-2e078de6-71e2-4eb0-8112-376831f23372 service nova] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e468c598-f03b-4ade-98e4-115d3a046c25 req-2e078de6-71e2-4eb0-8112-376831f23372 service nova] Lock "15e2beda-544e-419b-b345-99f439670e0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-e468c598-f03b-4ade-98e4-115d3a046c25 req-2e078de6-71e2-4eb0-8112-376831f23372 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] No waiting events found dispatching network-vif-plugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:01 user nova-compute[76442]: WARNING nova.compute.manager [req-e468c598-f03b-4ade-98e4-115d3a046c25 req-2e078de6-71e2-4eb0-8112-376831f23372 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received unexpected event network-vif-plugged-62c9899e-37d0-44cd-b4c8-0b6edb19133c for instance with vm_state active and task_state deleting.
Nov 14 20:37:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Snapshot extracted, beginning image upload
Nov 14 20:37:02 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e9e62a6-27bd-4c43-88cf-99d31c3090c6 req-f1cb7101-fb3c-40d9-bc29-97642843f899 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Received event network-vif-deleted-62c9899e-37d0-44cd-b4c8-0b6edb19133c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:02 user nova-compute[76442]: INFO nova.compute.manager [req-4e9e62a6-27bd-4c43-88cf-99d31c3090c6 req-f1cb7101-fb3c-40d9-bc29-97642843f899 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Neutron deleted interface 62c9899e-37d0-44cd-b4c8-0b6edb19133c; detaching it from the instance and deleting it from the info cache
Nov 14 20:37:02 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e9e62a6-27bd-4c43-88cf-99d31c3090c6 req-f1cb7101-fb3c-40d9-bc29-97642843f899 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:02 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Took 0.60 seconds to deallocate network for instance.
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e9e62a6-27bd-4c43-88cf-99d31c3090c6 req-f1cb7101-fb3c-40d9-bc29-97642843f899 service nova] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Detach interface failed, port_id=62c9899e-37d0-44cd-b4c8-0b6edb19133c, reason: Instance 15e2beda-544e-419b-b345-99f439670e0c could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:03 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:37:03 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=6991MB free_disk=25.44634246826172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 15e2beda-544e-419b-b345-99f439670e0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance da018992-79f4-4db3-bbf7-a492508ff629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 36d98f74-5652-445d-a06a-14b59aa3fa80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 81e9fdfe-5853-4728-9618-d50ee80fa7fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:37:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:04 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Snapshot image upload complete
Nov 14 20:37:04 user nova-compute[76442]: INFO nova.compute.manager [None req-17b91d24-179b-424d-8c7d-744d686a74e5 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Took 5.63 seconds to snapshot the instance on the hypervisor.
Nov 14 20:37:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:07 user nova-compute[76442]: INFO nova.compute.manager [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] [instance: 15e2beda-544e-419b-b345-99f439670e0c] Took 5.89 seconds to detach 1 volumes for instance.
Nov 14 20:37:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPLCEwIv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:08 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:08 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:08 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLcysEmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:08 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad8a52a-5664-43c0-89d5-292470816f18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:37:08 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7357b5aa-bd15-427c-b588-adff12f3b61d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b] added
Nov 14 20:37:08 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c500eb4-2104-4f15-a3ea-661215423b05]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ba1546-4439-4f83-8b96-5cdfddc76449]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPLCEwIv {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPLCEwIv" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ca0bdb-f6de-4397-9094-17f98fae34eb]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPLCEwIv'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca0ca0e-6a09-4ae8-866b-de163a632098]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b342ef-47a4-427b-ba41-66bc3e76d420]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:08 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:08 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d43ff1-ccc4-475b-947a-d500cf1aea24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b, portal: 172.16.0.220,3260]
Nov 14 20:37:08 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:08 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9386a485-b0f2-4ba7-84aa-17fe30f8000d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cd6636-86b3-48b1-8706-7918f4c5a04f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:08 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:08 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:08 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[56930650-8c57-4136-92f9-fefdac6b03d0]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPLCEwIv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:37:08 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Deleted allocations for instance 15e2beda-544e-419b-b345-99f439670e0c
Nov 14 20:37:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-594b1d7d-d68a-4745-a779-7c36678a4428 tempest-DeleteServersTestJSON-968047679 tempest-DeleteServersTestJSON-968047679-project-member] Lock "15e2beda-544e-419b-b345-99f439670e0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23763363063396665', 'path': '/dev/sde'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763363063396665', 'path': '/dev/sde'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.287s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:09 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:09 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG nova.objects.instance [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'flavor' on Instance uuid da018992-79f4-4db3-bbf7-a492508ff629 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d107c4cb-42cc-4ce8-b0bd-c1bc3dcf202c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:37:09 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:37:09 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:09 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:37:09 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:09 user nova-compute[76442]:   <serial>c0c6480a-cde4-4f36-a8da-55c28f18198b</serial>
Nov 14 20:37:09 user nova-compute[76442]: </disk>
Nov 14 20:37:09 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780654a-2768-48c6-85f0-64171c440d9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64] added
Nov 14 20:37:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea0b99c-d4d1-477a-9bc6-bc7c997357bc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8e1036-ec15-4057-90fa-255dcaffc0f7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLcysEmV {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLcysEmV" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bbdb89-21c6-413b-8fcf-ff4635a516ae]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BLcysEmV'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[07157a98-f813-4efb-ab22-2f58c98c4906]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b2e15f-4db8-429b-acca-c5e939c0b5a2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7877ec-ac74-4788-a3ae-70e40895ceca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260]
Nov 14 20:37:09 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833dd52-1b1d-4ea0-8580-bac938cafcb2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9114a30b-e8d8-4e98-912a-06f9951fd59a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:09 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b446edb0-c1f7-404d-b9bf-b2fafc65da39]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLcysEmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No VIF found with MAC fa:16:3e:af:e1:6e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:37:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b38b686b-c958-4955-a295-81a54359b446 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.305s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:10 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:10 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== connect_volume: return (2575ms) {'type': 'block', 'scsi_wwn': '26163386262383435', 'path': '/dev/sdf'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163386262383435', 'path': '/dev/sdf'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:37:10 user nova-compute[76442]: DEBUG nova.objects.instance [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:37:10 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:10 user nova-compute[76442]:   <source dev="/dev/sdf"/>
Nov 14 20:37:10 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:10 user nova-compute[76442]:   <serial>94bbbc8a-4c4c-4876-bca5-19a6e3f07d64</serial>
Nov 14 20:37:10 user nova-compute[76442]: </disk>
Nov 14 20:37:10 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:37:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No VIF found with MAC fa:16:3e:d2:0d:f0, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:37:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ecb849d9-fd52-485c-8e37-a84d8f2a2b11 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.054s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fdbc7b70-f655-4692-81c4-195d1cbbf7d6 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fdbc7b70-f655-4692-81c4-195d1cbbf7d6 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fdbc7b70-f655-4692-81c4-195d1cbbf7d6 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fdbc7b70-f655-4692-81c4-195d1cbbf7d6 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76442) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG nova.objects.instance [None req-fdbc7b70-f655-4692-81c4-195d1cbbf7d6 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-cb8f64f9-54b1-4cff-81ab-e0cf62de0d82 req-24ea9dd9-1b04-4ca6-8b6a-72bc386b20aa service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-unplugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cb8f64f9-54b1-4cff-81ab-e0cf62de0d82 req-24ea9dd9-1b04-4ca6-8b6a-72bc386b20aa service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cb8f64f9-54b1-4cff-81ab-e0cf62de0d82 req-24ea9dd9-1b04-4ca6-8b6a-72bc386b20aa service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cb8f64f9-54b1-4cff-81ab-e0cf62de0d82 req-24ea9dd9-1b04-4ca6-8b6a-72bc386b20aa service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-cb8f64f9-54b1-4cff-81ab-e0cf62de0d82 req-24ea9dd9-1b04-4ca6-8b6a-72bc386b20aa service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-unplugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:12 user nova-compute[76442]: WARNING nova.compute.manager [req-cb8f64f9-54b1-4cff-81ab-e0cf62de0d82 req-24ea9dd9-1b04-4ca6-8b6a-72bc386b20aa service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-unplugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state active and task_state powering-off.
Nov 14 20:37:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "5f080799-d27b-4765-b4fd-5842bae26067" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "5f080799-d27b-4765-b4fd-5842bae26067" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:37:13 user nova-compute[76442]: INFO nova.compute.claims [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Claim successful on node user
Nov 14 20:37:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance destroyed successfully.
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fdbc7b70-f655-4692-81c4-195d1cbbf7d6 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fdbc7b70-f655-4692-81c4-195d1cbbf7d6 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.865s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:37:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-b5ad862b-606b-44fb-8a36-6f35cc4cf97a req-5c6e232a-c097-471e-9471-cc7f29421b9c service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received event network-changed-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-b5ad862b-606b-44fb-8a36-6f35cc4cf97a req-5c6e232a-c097-471e-9471-cc7f29421b9c service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Refreshing instance network info cache due to event network-changed-0b7921ee-3266-4e01-996e-b9f62b1b589a. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b5ad862b-606b-44fb-8a36-6f35cc4cf97a req-5c6e232a-c097-471e-9471-cc7f29421b9c service nova] Acquiring lock "refresh_cache-24c3abec-1233-45d1-a5ce-d5a14f76b313" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b5ad862b-606b-44fb-8a36-6f35cc4cf97a req-5c6e232a-c097-471e-9471-cc7f29421b9c service nova] Acquired lock "refresh_cache-24c3abec-1233-45d1-a5ce-d5a14f76b313" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-b5ad862b-606b-44fb-8a36-6f35cc4cf97a req-5c6e232a-c097-471e-9471-cc7f29421b9c service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Refreshing network info cache for port 0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.policy [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05ec208e91594c36a30683258c9c687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd9ff5bbf1a49cca0d72a3ab4b34432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:37:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Creating image(s)
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "/opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "/opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.network.neutron [req-b5ad862b-606b-44fb-8a36-6f35cc4cf97a req-5c6e232a-c097-471e-9471-cc7f29421b9c service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Updated VIF entry in instance network info cache for port 0b7921ee-3266-4e01-996e-b9f62b1b589a. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.network.neutron [req-b5ad862b-606b-44fb-8a36-6f35cc4cf97a req-5c6e232a-c097-471e-9471-cc7f29421b9c service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Updating instance_info_cache with network_info: [{"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk 1073741824" returned: 0 in 0.077s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b5ad862b-606b-44fb-8a36-6f35cc4cf97a req-5c6e232a-c097-471e-9471-cc7f29421b9c service nova] Releasing lock "refresh_cache-24c3abec-1233-45d1-a5ce-d5a14f76b313" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Successfully created port: 3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Cannot resize image /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Ensure instance console log exists: /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Successfully updated port: 3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "refresh_cache-5f080799-d27b-4765-b4fd-5842bae26067" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquired lock "refresh_cache-5f080799-d27b-4765-b4fd-5842bae26067" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-0a135f9c-0417-4325-ae22-4097be85e2a4 req-3657a8ee-13c1-4f37-af00-98d75fe55f15 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Received event network-changed-3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-0a135f9c-0417-4325-ae22-4097be85e2a4 req-3657a8ee-13c1-4f37-af00-98d75fe55f15 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Refreshing instance network info cache due to event network-changed-3182023d-98da-44fb-b40a-019fb12a70c4. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0a135f9c-0417-4325-ae22-4097be85e2a4 req-3657a8ee-13c1-4f37-af00-98d75fe55f15 service nova] Acquiring lock "refresh_cache-5f080799-d27b-4765-b4fd-5842bae26067" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-9e7d8661-300d-4f95-8994-b7154c4b9fcc req-6da11d28-7e88-4ec8-99bf-7e283bf3bab0 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9e7d8661-300d-4f95-8994-b7154c4b9fcc req-6da11d28-7e88-4ec8-99bf-7e283bf3bab0 service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9e7d8661-300d-4f95-8994-b7154c4b9fcc req-6da11d28-7e88-4ec8-99bf-7e283bf3bab0 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9e7d8661-300d-4f95-8994-b7154c4b9fcc req-6da11d28-7e88-4ec8-99bf-7e283bf3bab0 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-9e7d8661-300d-4f95-8994-b7154c4b9fcc req-6da11d28-7e88-4ec8-99bf-7e283bf3bab0 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:14 user nova-compute[76442]: WARNING nova.compute.manager [req-9e7d8661-300d-4f95-8994-b7154c4b9fcc req-6da11d28-7e88-4ec8-99bf-7e283bf3bab0 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state stopped and task_state None.
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Updating instance_info_cache with network_info: [{"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Releasing lock "refresh_cache-5f080799-d27b-4765-b4fd-5842bae26067" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Instance network_info: |[{"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0a135f9c-0417-4325-ae22-4097be85e2a4 req-3657a8ee-13c1-4f37-af00-98d75fe55f15 service nova] Acquired lock "refresh_cache-5f080799-d27b-4765-b4fd-5842bae26067" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-0a135f9c-0417-4325-ae22-4097be85e2a4 req-3657a8ee-13c1-4f37-af00-98d75fe55f15 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Refreshing network info cache for port 3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Start _get_guest_xml network_info=[{"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:37:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:37:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1941064526',display_name='tempest-AttachVolumeNegativeTest-server-1941064526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1941064526',id=12,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOQ3HAY8ZP14gmoQ0tILXsq50z6fx1vNoA+EvkSx29Y6VnnCMRaPaL0l9FBTJZDSwsfKH5Mf5XtU3po3sUmwpJ6FlnbmjeQF5ANniBviFfw72ufE0+q8GJkw4EkboOaGw==',key_name='tempest-keypair-1092319666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-l2z3d8dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=5f080799-d27b-4765-b4fd-5842bae26067,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=3182023d-98da-44fb-b40a-019fb12a70c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3182023d-98') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.objects.instance [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f080799-d27b-4765-b4fd-5842bae26067 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:37:15 user nova-compute[76442]:   <uuid>5f080799-d27b-4765-b4fd-5842bae26067</uuid>
Nov 14 20:37:15 user nova-compute[76442]:   <name>instance-0000000c</name>
Nov 14 20:37:15 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:37:15 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:37:15 user nova-compute[76442]:   <metadata>
Nov 14 20:37:15 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:37:15 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:37:15 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1941064526</nova:name>
Nov 14 20:37:15 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:37:15</nova:creationTime>
Nov 14 20:37:15 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:37:15 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:37:15 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:37:15 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:37:15 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:37:15 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:37:15 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:37:15 user nova-compute[76442]:       <nova:owner>
Nov 14 20:37:15 user nova-compute[76442]:         <nova:user uuid="05ec208e91594c36a30683258c9c687d">tempest-AttachVolumeNegativeTest-1957433764-project-member</nova:user>
Nov 14 20:37:15 user nova-compute[76442]:         <nova:project uuid="5bd9ff5bbf1a49cca0d72a3ab4b34432">tempest-AttachVolumeNegativeTest-1957433764</nova:project>
Nov 14 20:37:15 user nova-compute[76442]:       </nova:owner>
Nov 14 20:37:15 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:37:15 user nova-compute[76442]:       <nova:ports>
Nov 14 20:37:15 user nova-compute[76442]:         <nova:port uuid="3182023d-98da-44fb-b40a-019fb12a70c4">
Nov 14 20:37:15 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 20:37:15 user nova-compute[76442]:         </nova:port>
Nov 14 20:37:15 user nova-compute[76442]:       </nova:ports>
Nov 14 20:37:15 user nova-compute[76442]:     </nova:instance>
Nov 14 20:37:15 user nova-compute[76442]:   </metadata>
Nov 14 20:37:15 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:37:15 user nova-compute[76442]:     <system>
Nov 14 20:37:15 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:37:15 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:37:15 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:37:15 user nova-compute[76442]:       <entry name="serial">5f080799-d27b-4765-b4fd-5842bae26067</entry>
Nov 14 20:37:15 user nova-compute[76442]:       <entry name="uuid">5f080799-d27b-4765-b4fd-5842bae26067</entry>
Nov 14 20:37:15 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:37:15 user nova-compute[76442]:     </system>
Nov 14 20:37:15 user nova-compute[76442]:   </sysinfo>
Nov 14 20:37:15 user nova-compute[76442]:   <os>
Nov 14 20:37:15 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:37:15 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:37:15 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:37:15 user nova-compute[76442]:   </os>
Nov 14 20:37:15 user nova-compute[76442]:   <features>
Nov 14 20:37:15 user nova-compute[76442]:     <acpi/>
Nov 14 20:37:15 user nova-compute[76442]:     <apic/>
Nov 14 20:37:15 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:37:15 user nova-compute[76442]:   </features>
Nov 14 20:37:15 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:37:15 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:37:15 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:37:15 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:37:15 user nova-compute[76442]:   </clock>
Nov 14 20:37:15 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:37:15 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:37:15 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:37:15 user nova-compute[76442]:   </cpu>
Nov 14 20:37:15 user nova-compute[76442]:   <devices>
Nov 14 20:37:15 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:37:15 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:37:15 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk"/>
Nov 14 20:37:15 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:37:15 user nova-compute[76442]:     </disk>
Nov 14 20:37:15 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:37:15 user nova-compute[76442]:       <mac address="fa:16:3e:c2:e4:7a"/>
Nov 14 20:37:15 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:37:15 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:37:15 user nova-compute[76442]:       <target dev="tap3182023d-98"/>
Nov 14 20:37:15 user nova-compute[76442]:     </interface>
Nov 14 20:37:15 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:37:15 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/console.log" append="off"/>
Nov 14 20:37:15 user nova-compute[76442]:     </serial>
Nov 14 20:37:15 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:37:15 user nova-compute[76442]:     <video>
Nov 14 20:37:15 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:37:15 user nova-compute[76442]:     </video>
Nov 14 20:37:15 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:37:15 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:37:15 user nova-compute[76442]:     </rng>
Nov 14 20:37:15 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:37:15 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:37:15 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:37:15 user nova-compute[76442]:     </memballoon>
Nov 14 20:37:15 user nova-compute[76442]:   </devices>
Nov 14 20:37:15 user nova-compute[76442]: </domain>
Nov 14 20:37:15 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1941064526',display_name='tempest-AttachVolumeNegativeTest-server-1941064526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1941064526',id=12,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOQ3HAY8ZP14gmoQ0tILXsq50z6fx1vNoA+EvkSx29Y6VnnCMRaPaL0l9FBTJZDSwsfKH5Mf5XtU3po3sUmwpJ6FlnbmjeQF5ANniBviFfw72ufE0+q8GJkw4EkboOaGw==',key_name='tempest-keypair-1092319666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-l2z3d8dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=5f080799-d27b-4765-b4fd-5842bae26067,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=3182023d-98da-44fb-b40a-019fb12a70c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3182023d-98') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG os_vif [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=3182023d-98da-44fb-b40a-019fb12a70c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3182023d-98') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58f20531-7faa-5180-8c9b-3692602a5f57', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3182023d-98, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3182023d-98, col_values=(('qos', UUID('3246cd4a-17b6-4047-b644-6731fddadfe7')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3182023d-98, col_values=(('external_ids', {'iface-id': '3182023d-98da-44fb-b40a-019fb12a70c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:e4:7a', 'vm-uuid': '5f080799-d27b-4765-b4fd-5842bae26067'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:15 user nova-compute[76442]: INFO os_vif [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=3182023d-98da-44fb-b40a-019fb12a70c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3182023d-98')
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lazy-loading 'flavor' on Instance uuid 24c3abec-1233-45d1-a5ce-d5a14f76b313 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No VIF found with MAC fa:16:3e:c2:e4:7a, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:15 user nova-compute[76442]: INFO nova.compute.manager [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Attaching volume abdc6957-283c-4de9-acb5-9e5835f683b9 to /dev/vdb
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-0a135f9c-0417-4325-ae22-4097be85e2a4 req-3657a8ee-13c1-4f37-af00-98d75fe55f15 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Updated VIF entry in instance network info cache for port 3182023d-98da-44fb-b40a-019fb12a70c4. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-0a135f9c-0417-4325-ae22-4097be85e2a4 req-3657a8ee-13c1-4f37-af00-98d75fe55f15 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Updating instance_info_cache with network_info: [{"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0a135f9c-0417-4325-ae22-4097be85e2a4 req-3657a8ee-13c1-4f37-af00-98d75fe55f15 service nova] Releasing lock "refresh_cache-5f080799-d27b-4765-b4fd-5842bae26067" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG os_brick.utils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ae3f5c-c32a-4203-8aef-bb5a62d1f0d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[742e652b-b768-4084-a01f-d7da62504245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db3fb89-38d2-416e-8817-14971cbe47fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbcc84b-d198-4b67-9eb3-51a5ede5a706]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:15 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:37:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb8a2f2-3bf3-4e4a-bb1d-077b396a1a8d]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG os_brick.utils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:15 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Updating existing volume attachment record: 3abd93e2-308f-472f-8996-f429c666a88d {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-fa05005c-663e-4d3f-8015-f04beda74235 req-bf88bdb8-883e-42a7-871e-6da07b73b359 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Received event network-vif-plugged-3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fa05005c-663e-4d3f-8015-f04beda74235 req-bf88bdb8-883e-42a7-871e-6da07b73b359 service nova] Acquiring lock "5f080799-d27b-4765-b4fd-5842bae26067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fa05005c-663e-4d3f-8015-f04beda74235 req-bf88bdb8-883e-42a7-871e-6da07b73b359 service nova] Lock "5f080799-d27b-4765-b4fd-5842bae26067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fa05005c-663e-4d3f-8015-f04beda74235 req-bf88bdb8-883e-42a7-871e-6da07b73b359 service nova] Lock "5f080799-d27b-4765-b4fd-5842bae26067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-fa05005c-663e-4d3f-8015-f04beda74235 req-bf88bdb8-883e-42a7-871e-6da07b73b359 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] No waiting events found dispatching network-vif-plugged-3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:16 user nova-compute[76442]: WARNING nova.compute.manager [req-fa05005c-663e-4d3f-8015-f04beda74235 req-bf88bdb8-883e-42a7-871e-6da07b73b359 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Received unexpected event network-vif-plugged-3182023d-98da-44fb-b40a-019fb12a70c4 for instance with vm_state building and task_state spawning.
Nov 14 20:37:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-6c8fc395-5d14-456c-93e1-a4f3789e4cbe req-0694afed-2685-49a4-81ed-347006d4505a service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received event network-changed-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-6c8fc395-5d14-456c-93e1-a4f3789e4cbe req-0694afed-2685-49a4-81ed-347006d4505a service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Refreshing instance network info cache due to event network-changed-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6c8fc395-5d14-456c-93e1-a4f3789e4cbe req-0694afed-2685-49a4-81ed-347006d4505a service nova] Acquiring lock "refresh_cache-36d98f74-5652-445d-a06a-14b59aa3fa80" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6c8fc395-5d14-456c-93e1-a4f3789e4cbe req-0694afed-2685-49a4-81ed-347006d4505a service nova] Acquired lock "refresh_cache-36d98f74-5652-445d-a06a-14b59aa3fa80" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:16 user nova-compute[76442]: DEBUG nova.network.neutron [req-6c8fc395-5d14-456c-93e1-a4f3789e4cbe req-0694afed-2685-49a4-81ed-347006d4505a service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Refreshing network info cache for port 647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:37:17 user nova-compute[76442]: DEBUG nova.network.neutron [req-6c8fc395-5d14-456c-93e1-a4f3789e4cbe req-0694afed-2685-49a4-81ed-347006d4505a service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Updated VIF entry in instance network info cache for port 647bee4f-1167-49c0-9e8b-7d0fef7ebdf7. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:37:17 user nova-compute[76442]: DEBUG nova.network.neutron [req-6c8fc395-5d14-456c-93e1-a4f3789e4cbe req-0694afed-2685-49a4-81ed-347006d4505a service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Updating instance_info_cache with network_info: [{"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6c8fc395-5d14-456c-93e1-a4f3789e4cbe req-0694afed-2685-49a4-81ed-347006d4505a service nova] Releasing lock "refresh_cache-36d98f74-5652-445d-a06a-14b59aa3fa80" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:17 user nova-compute[76442]: DEBUG nova.objects.instance [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lazy-loading 'flavor' on Instance uuid 36d98f74-5652-445d-a06a-14b59aa3fa80 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:18 user nova-compute[76442]: INFO nova.compute.manager [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Attaching volume 1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 to /dev/sdc
Nov 14 20:37:18 user nova-compute[76442]: DEBUG os_brick.utils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[79352e0b-602c-4167-911b-d10a09af7f36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e5b058-8808-447c-ad91-8468c3ee7acd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c561b4b-fbcb-40b7-8be6-9e23ae3f420c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae76362c-9afc-466e-aaaf-a3582a33459c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:18 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6199605d-d056-42e1-91e2-cdba2517fd02]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG os_brick.utils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Updating existing volume attachment record: 824df462-b6e3-41fe-b1df-c9580740e21f {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:37:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Instance spawned successfully.
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Received event network-vif-plugged-3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] Acquiring lock "5f080799-d27b-4765-b4fd-5842bae26067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] Lock "5f080799-d27b-4765-b4fd-5842bae26067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] Lock "5f080799-d27b-4765-b4fd-5842bae26067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] No waiting events found dispatching network-vif-plugged-3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:18 user nova-compute[76442]: WARNING nova.compute.manager [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Received unexpected event network-vif-plugged-3182023d-98da-44fb-b40a-019fb12a70c4 for instance with vm_state building and task_state spawning.
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-changed-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Refreshing instance network info cache due to event network-changed-419e15ae-a9b1-4eab-b39e-40668ff94442. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] Acquiring lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] Acquired lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Refreshing network info cache for port 419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:37:18 user nova-compute[76442]: INFO nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 14 20:37:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:37:19 user nova-compute[76442]: INFO nova.compute.manager [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Took 6.05 seconds to build instance.
Nov 14 20:37:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8e27d87d-e2dc-4188-b4ba-36ea5ae3f8ff tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "5f080799-d27b-4765-b4fd-5842bae26067" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.157s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "interface-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "interface-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG nova.objects.instance [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lazy-loading 'flavor' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG nova.objects.instance [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lazy-loading 'pci_requests' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG nova.objects.base [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Object Instance<d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3> lazy-loaded attributes: flavor,pci_requests {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG nova.network.neutron [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updated VIF entry in instance network info cache for port 419e15ae-a9b1-4eab-b39e-40668ff94442. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG nova.network.neutron [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updating instance_info_cache with network_info: [{"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-746d97d4-fc6a-4c60-982f-8c398fb3dd0b req-0634969a-26e5-45c2-86db-994125f05587 service nova] Releasing lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG nova.policy [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea5cd68ca82b403894574c8cca866c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19f15871cfc46a797bebbc7b4bd98c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:37:19 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Successfully created port: 2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtbqZerA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:20 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:20 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:20 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc2981e-cd3b-41ef-9c73-28eda55f791a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:37:20 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[baacfcf3-ce68-45b7-84ba-5af5adae7588]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9] added
Nov 14 20:37:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a821c4-e3ad-4034-a0b0-969b43583800]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f8802-7048-42ff-bc0b-4c41c1eb48f5]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtbqZerA {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Successfully updated port: 2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtbqZerA" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c47cc84-d08f-410e-b881-9a005839ccfc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtbqZerA'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquired lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba01a73-797c-4fb4-a783-8d42eb4903a6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-0744c098-d014-404f-82fb-6d5ce8bb9189 req-ee21147e-4c39-4d7c-8d34-c02a75dfe192 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-changed-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-0744c098-d014-404f-82fb-6d5ce8bb9189 req-ee21147e-4c39-4d7c-8d34-c02a75dfe192 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Refreshing instance network info cache due to event network-changed-2ebe3f06-096a-47c4-b919-cae47e172d91. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0744c098-d014-404f-82fb-6d5ce8bb9189 req-ee21147e-4c39-4d7c-8d34-c02a75dfe192 service nova] Acquiring lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bf37a2-b1af-4a78-a365-ad83d92b7bb0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23c49df-3d4f-4f36-824a-2f97650079c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9, portal: 172.16.0.220,3260]
Nov 14 20:37:20 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a409d31d-6dfd-469f-a7b8-b314accd84e7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02df0a5-2f0f-445c-97fb-f4ed5fc3d677]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6160d47-8df4-4374-9876-979451e41e70]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtbqZerA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updating instance_info_cache with network_info: [{"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Releasing lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0744c098-d014-404f-82fb-6d5ce8bb9189 req-ee21147e-4c39-4d7c-8d34-c02a75dfe192 service nova] Acquired lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.network.neutron [req-0744c098-d014-404f-82fb-6d5ce8bb9189 req-ee21147e-4c39-4d7c-8d34-c02a75dfe192 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Refreshing network info cache for port 2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1907993261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1907993261',id=8,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhiKJDZyTPUP42ifz5q1yPR2La2BoXPkYuIiGMuPResfJc+REH8acsUVh7+sZXo4dZ9+7k9ar1BYGHmzCSWGtVHpMzaDRVfYcUEnOUl+Cf9Cuyjn9931vx9cWZ5wDkQA==',key_name='tempest-keypair-1903225505',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d19f15871cfc46a797bebbc7b4bd98c8',ramdisk_id='',reservation_id='r-ozgig145',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-882538911',owner_user_name='tempest-TaggedAttachmentsTest-882538911-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5cd68ca82b403894574c8cca866c0a',uuid=d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converting VIF {"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG os_vif [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5ae1604-06da-5091-86a7-c99b2fd6d4be', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ebe3f06-09, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ebe3f06-09, col_values=(('qos', UUID('03929cbe-6797-416e-b0e8-0d14775b9735')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ebe3f06-09, col_values=(('external_ids', {'iface-id': '2ebe3f06-096a-47c4-b919-cae47e172d91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:d7:f1', 'vm-uuid': 'd3f77d6b-26a2-4bfc-b3f3-52b023c0aad3'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: INFO os_vif [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09')
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1907993261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1907993261',id=8,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhiKJDZyTPUP42ifz5q1yPR2La2BoXPkYuIiGMuPResfJc+REH8acsUVh7+sZXo4dZ9+7k9ar1BYGHmzCSWGtVHpMzaDRVfYcUEnOUl+Cf9Cuyjn9931vx9cWZ5wDkQA==',key_name='tempest-keypair-1903225505',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d19f15871cfc46a797bebbc7b4bd98c8',ramdisk_id='',reservation_id='r-ozgig145',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-882538911',owner_user_name='tempest-TaggedAttachmentsTest-882538911-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5cd68ca82b403894574c8cca866c0a',uuid=d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converting VIF {"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] attach device xml: <interface type="ethernet">
Nov 14 20:37:21 user nova-compute[76442]:   <mac address="fa:16:3e:0f:d7:f1"/>
Nov 14 20:37:21 user nova-compute[76442]:   <model type="virtio"/>
Nov 14 20:37:21 user nova-compute[76442]:   <mtu size="1442"/>
Nov 14 20:37:21 user nova-compute[76442]:   <target dev="tap2ebe3f06-09"/>
Nov 14 20:37:21 user nova-compute[76442]: </interface>
Nov 14 20:37:21 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-7ba2eb56-a648-447f-b472-1bf15d0ceca5 req-ba88a118-975e-43d2-bb07-42b52bcce4e0 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received event network-changed-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-7ba2eb56-a648-447f-b472-1bf15d0ceca5 req-ba88a118-975e-43d2-bb07-42b52bcce4e0 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Refreshing instance network info cache due to event network-changed-5cf3cee4-4d55-46b3-9142-8b752b4a366b. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7ba2eb56-a648-447f-b472-1bf15d0ceca5 req-ba88a118-975e-43d2-bb07-42b52bcce4e0 service nova] Acquiring lock "refresh_cache-903f5659-0c6b-46c0-a3b1-02b8ada7154a" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7ba2eb56-a648-447f-b472-1bf15d0ceca5 req-ba88a118-975e-43d2-bb07-42b52bcce4e0 service nova] Acquired lock "refresh_cache-903f5659-0c6b-46c0-a3b1-02b8ada7154a" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.network.neutron [req-7ba2eb56-a648-447f-b472-1bf15d0ceca5 req-ba88a118-975e-43d2-bb07-42b52bcce4e0 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Refreshing network info cache for port 5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.network.neutron [req-0744c098-d014-404f-82fb-6d5ce8bb9189 req-ee21147e-4c39-4d7c-8d34-c02a75dfe192 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updated VIF entry in instance network info cache for port 2ebe3f06-096a-47c4-b919-cae47e172d91. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.network.neutron [req-0744c098-d014-404f-82fb-6d5ce8bb9189 req-ee21147e-4c39-4d7c-8d34-c02a75dfe192 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updating instance_info_cache with network_info: [{"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0744c098-d014-404f-82fb-6d5ce8bb9189 req-ee21147e-4c39-4d7c-8d34-c02a75dfe192 service nova] Releasing lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] No BDM found with device name hda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] No VIF found with MAC fa:16:3e:18:ab:0a, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.objects.instance [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lazy-loading 'flavor' on Instance uuid 903f5659-0c6b-46c0-a3b1-02b8ada7154a {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:37:21 user nova-compute[76442]:   <nova:package version="0.0.0"/>
Nov 14 20:37:21 user nova-compute[76442]:   <nova:name>tempest-device-tagging-server-1907993261</nova:name>
Nov 14 20:37:21 user nova-compute[76442]:   <nova:creationTime>2023-11-14 20:37:21</nova:creationTime>
Nov 14 20:37:21 user nova-compute[76442]:   <nova:flavor name="m1.tiny">
Nov 14 20:37:21 user nova-compute[76442]:     <nova:memory>512</nova:memory>
Nov 14 20:37:21 user nova-compute[76442]:     <nova:disk>1</nova:disk>
Nov 14 20:37:21 user nova-compute[76442]:     <nova:swap>0</nova:swap>
Nov 14 20:37:21 user nova-compute[76442]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:37:21 user nova-compute[76442]:     <nova:vcpus>1</nova:vcpus>
Nov 14 20:37:21 user nova-compute[76442]:   </nova:flavor>
Nov 14 20:37:21 user nova-compute[76442]:   <nova:owner>
Nov 14 20:37:21 user nova-compute[76442]:     <nova:user uuid="ea5cd68ca82b403894574c8cca866c0a">tempest-TaggedAttachmentsTest-882538911-project-member</nova:user>
Nov 14 20:37:21 user nova-compute[76442]:     <nova:project uuid="d19f15871cfc46a797bebbc7b4bd98c8">tempest-TaggedAttachmentsTest-882538911</nova:project>
Nov 14 20:37:21 user nova-compute[76442]:   </nova:owner>
Nov 14 20:37:21 user nova-compute[76442]:   <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:37:21 user nova-compute[76442]:   <nova:ports>
Nov 14 20:37:21 user nova-compute[76442]:     <nova:port uuid="419e15ae-a9b1-4eab-b39e-40668ff94442">
Nov 14 20:37:21 user nova-compute[76442]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:37:21 user nova-compute[76442]:     </nova:port>
Nov 14 20:37:21 user nova-compute[76442]:     <nova:port uuid="2ebe3f06-096a-47c4-b919-cae47e172d91">
Nov 14 20:37:21 user nova-compute[76442]:       <nova:ip type="fixed" address="10.10.10.13" ipVersion="4"/>
Nov 14 20:37:21 user nova-compute[76442]:     </nova:port>
Nov 14 20:37:21 user nova-compute[76442]:   </nova:ports>
Nov 14 20:37:21 user nova-compute[76442]: </nova:instance>
Nov 14 20:37:21 user nova-compute[76442]:  {{(pid=76442) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23536383765313831', 'path': '/dev/sdg'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536383765313831', 'path': '/dev/sdg'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lazy-loading 'flavor' on Instance uuid 24c3abec-1233-45d1-a5ce-d5a14f76b313 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92fec9ec-b9e6-436e-a1e7-0a6aafd64072 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "interface-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.743s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:37:21 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:21 user nova-compute[76442]:   <source dev="/dev/sdg"/>
Nov 14 20:37:21 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:21 user nova-compute[76442]:   <serial>abdc6957-283c-4de9-acb5-9e5835f683b9</serial>
Nov 14 20:37:21 user nova-compute[76442]: </disk>
Nov 14 20:37:21 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-a015bfd1-2aff-45f4-ab3c-8abac4ff855f req-ee8709ba-ffb5-41ae-84f1-36e3d1649f14 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-plugged-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a015bfd1-2aff-45f4-ab3c-8abac4ff855f req-ee8709ba-ffb5-41ae-84f1-36e3d1649f14 service nova] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a015bfd1-2aff-45f4-ab3c-8abac4ff855f req-ee8709ba-ffb5-41ae-84f1-36e3d1649f14 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a015bfd1-2aff-45f4-ab3c-8abac4ff855f req-ee8709ba-ffb5-41ae-84f1-36e3d1649f14 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-a015bfd1-2aff-45f4-ab3c-8abac4ff855f req-ee8709ba-ffb5-41ae-84f1-36e3d1649f14 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] No waiting events found dispatching network-vif-plugged-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:21 user nova-compute[76442]: WARNING nova.compute.manager [req-a015bfd1-2aff-45f4-ab3c-8abac4ff855f req-ee8709ba-ffb5-41ae-84f1-36e3d1649f14 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received unexpected event network-vif-plugged-2ebe3f06-096a-47c4-b919-cae47e172d91 for instance with vm_state active and task_state None.
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:22 user nova-compute[76442]: INFO nova.compute.manager [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Attaching volume 7cee5223-982f-4854-9525-ec2947409772 to /dev/vdb
Nov 14 20:37:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.utils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b195501-281b-4574-9ffb-07a682367caa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb738c-d914-40a5-95b5-11bd0b7dfb97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b095f85b-96cd-479c-b95e-b43c997e91f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cfd4a7-df25-4b3f-a53e-637601655421]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:22 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6501b7-1eaa-49c0-a6d5-2722cd538f13]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.utils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Updating existing volume attachment record: 3c561259-935b-406d-bf8a-0e93b259ade5 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] No VIF found with MAC fa:16:3e:09:16:af, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG nova.network.neutron [req-7ba2eb56-a648-447f-b472-1bf15d0ceca5 req-ba88a118-975e-43d2-bb07-42b52bcce4e0 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Updated VIF entry in instance network info cache for port 5cf3cee4-4d55-46b3-9142-8b752b4a366b. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG nova.network.neutron [req-7ba2eb56-a648-447f-b472-1bf15d0ceca5 req-ba88a118-975e-43d2-bb07-42b52bcce4e0 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Updating instance_info_cache with network_info: [{"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG nova.objects.instance [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lazy-loading 'flavor' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7ba2eb56-a648-447f-b472-1bf15d0ceca5 req-ba88a118-975e-43d2-bb07-42b52bcce4e0 service nova] Releasing lock "refresh_cache-903f5659-0c6b-46c0-a3b1-02b8ada7154a" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e3478b2f-eb3b-42df-a07a-90e23829eaa0 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.027s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:22 user nova-compute[76442]: INFO nova.compute.manager [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Attaching volume 58603e24-a805-4a91-bbc6-01a56fa367ba to /dev/vdb
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.utils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b77fc8-3134-4ff3-be3d-b147cb597e34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf94f965-952f-4175-ba9f-78f6a0d49097]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1c6a5c-207b-44f0-9e75-9ecfa302bcf2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7884317a-d46c-48e2-83b0-b06d853c6e04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:22 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:37:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[75910756-13f9-49d9-803b-50fe7f8d2b3d]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG os_brick.utils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:22 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updating existing volume attachment record: 337225f9-82d9-4a03-ad99-c8dddeab9976 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQYuRkPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:23 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:23 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:23 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8711f97-8ff5-444a-a60f-eba24e231e71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:37:23 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4f29ba-7deb-41ff-b7c1-ccc1f18d4046]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667] added
Nov 14 20:37:23 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fe79f6-ed8e-4aa7-8dcc-dc1619dfd845]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e43957-652a-4b3b-bf55-b0ad7b69bd74]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQYuRkPD {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQYuRkPD" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd1735c-efc9-4674-892e-acd95e271b96]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KQYuRkPD'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1007372b-c363-4119-8d0f-afab1489e33e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a223a15-cc97-4830-9371-99cad8617704]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e01ce6-78db-4f52-909d-f4f15c71dbb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667, portal: 172.16.0.220,3260]
Nov 14 20:37:23 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:23 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19feb18-3d52-4119-abac-2c3dfce5a842]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0573a1-fb85-4e84-be45-157f67319c9d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:23 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4e7ee2-cfda-4892-b41a-78b21531f08a]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-805904f2-79eb-418a-bfe2-ed9407328d77 req-7776b001-fbb2-4e37-8386-6bc9040faaf6 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-plugged-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-805904f2-79eb-418a-bfe2-ed9407328d77 req-7776b001-fbb2-4e37-8386-6bc9040faaf6 service nova] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-805904f2-79eb-418a-bfe2-ed9407328d77 req-7776b001-fbb2-4e37-8386-6bc9040faaf6 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-805904f2-79eb-418a-bfe2-ed9407328d77 req-7776b001-fbb2-4e37-8386-6bc9040faaf6 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-805904f2-79eb-418a-bfe2-ed9407328d77 req-7776b001-fbb2-4e37-8386-6bc9040faaf6 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] No waiting events found dispatching network-vif-plugged-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:23 user nova-compute[76442]: WARNING nova.compute.manager [req-805904f2-79eb-418a-bfe2-ed9407328d77 req-7776b001-fbb2-4e37-8386-6bc9040faaf6 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received unexpected event network-vif-plugged-2ebe3f06-096a-47c4-b919-cae47e172d91 for instance with vm_state active and task_state None.
Nov 14 20:37:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:24 user nova-compute[76442]: INFO nova.compute.manager [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Detaching volume abdc6957-283c-4de9-acb5-9e5835f683b9
Nov 14 20:37:24 user nova-compute[76442]: INFO nova.virt.block_device [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Attempting to driver detach volume abdc6957-283c-4de9-acb5-9e5835f683b9 from mountpoint /dev/vdb
Nov 14 20:37:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Attempting to detach device vdb from instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:24 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:24 user nova-compute[76442]:   <source dev="/dev/sdg"/>
Nov 14 20:37:24 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:24 user nova-compute[76442]:   <serial>abdc6957-283c-4de9-acb5-9e5835f683b9</serial>
Nov 14 20:37:24 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:37:24 user nova-compute[76442]: </disk>
Nov 14 20:37:24 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:24 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Successfully detached device vdb from instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 from the persistent domain config.
Nov 14 20:37:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:24 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:24 user nova-compute[76442]:   <source dev="/dev/sdg"/>
Nov 14 20:37:24 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:24 user nova-compute[76442]:   <serial>abdc6957-283c-4de9-acb5-9e5835f683b9</serial>
Nov 14 20:37:24 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:37:24 user nova-compute[76442]: </disk>
Nov 14 20:37:24 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQYuRkPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23035333463653337', 'path': '/dev/sdh'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035333463653337', 'path': '/dev/sdh'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG nova.objects.instance [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lazy-loading 'flavor' on Instance uuid 36d98f74-5652-445d-a06a-14b59aa3fa80 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:37:24 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:24 user nova-compute[76442]:   <source dev="/dev/sdh"/>
Nov 14 20:37:24 user nova-compute[76442]:   <target dev="sdc" bus="scsi"/>
Nov 14 20:37:24 user nova-compute[76442]:   <serial>1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667</serial>
Nov 14 20:37:24 user nova-compute[76442]:   <address type="drive" controller="0" unit="2"/>
Nov 14 20:37:24 user nova-compute[76442]: </disk>
Nov 14 20:37:24 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:37:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:37:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] No BDM found with device name sda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] No BDM found with device name sdc, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] No VIF found with MAC fa:16:3e:cf:4c:a3, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:37:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-82df15d7-1b62-47e3-9251-473382decdf2 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.506s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:26 user nova-compute[76442]: INFO nova.compute.manager [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Detaching volume 1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667
Nov 14 20:37:26 user nova-compute[76442]: INFO nova.virt.block_device [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Attempting to driver detach volume 1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 from mountpoint /dev/sdc
Nov 14 20:37:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Attempting to detach device sdc from instance 36d98f74-5652-445d-a06a-14b59aa3fa80 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:37:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:26 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:26 user nova-compute[76442]:   <source dev="/dev/sdh"/>
Nov 14 20:37:26 user nova-compute[76442]:   <target dev="sdc" bus="scsi"/>
Nov 14 20:37:26 user nova-compute[76442]:   <serial>1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667</serial>
Nov 14 20:37:26 user nova-compute[76442]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 20:37:26 user nova-compute[76442]: </disk>
Nov 14 20:37:26 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Successfully detached device sdc from instance 36d98f74-5652-445d-a06a-14b59aa3fa80 from the persistent domain config.
Nov 14 20:37:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 36d98f74-5652-445d-a06a-14b59aa3fa80 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:37:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:26 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:26 user nova-compute[76442]:   <source dev="/dev/sdh"/>
Nov 14 20:37:26 user nova-compute[76442]:   <target dev="sdc" bus="scsi"/>
Nov 14 20:37:26 user nova-compute[76442]:   <serial>1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667</serial>
Nov 14 20:37:26 user nova-compute[76442]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 20:37:26 user nova-compute[76442]: </disk>
Nov 14 20:37:26 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 36d98f74-5652-445d-a06a-14b59aa3fa80 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkujZiJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:27 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:27 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:27 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[82252891-1db4-46b4-9b05-5932c73b3968]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:37:27 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa30761b-298f-42a6-965c-0e6de731e7a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772] added
Nov 14 20:37:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a46e39-c07d-4be4-a767-1cf79019eb67]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f0f783-be7f-4784-b77e-e0f7a5995bf5]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PkujZiJX {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PkujZiJX" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c93a17b-ad0c-43d1-aae8-8b657d15afac]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PkujZiJX'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f54004-df64-4e7d-83b4-7f4e49e2b633]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed38a5c-034f-419a-8709-f99c3fb4d823]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc19939e-9921-4302-bdcd-aaa9c2fcea66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260]
Nov 14 20:37:27 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa010297-887e-43f7-88df-0442867245d8]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c75f542-8200-41d5-9bd4-f05c3827074a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a236a9ff-16ca-432d-b56e-54c351566814]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkujZiJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjREFufD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:27 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23933643338623035', 'path': '/dev/sdi'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643338623035', 'path': '/dev/sdi'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.807s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:28 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:28 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG nova.objects.instance [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lazy-loading 'flavor' on Instance uuid 903f5659-0c6b-46c0-a3b1-02b8ada7154a {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ee180b-ec19-4f82-96b9-8219ddb2c7c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:37:28 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:37:28 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:28 user nova-compute[76442]:   <source dev="/dev/sdi"/>
Nov 14 20:37:28 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:28 user nova-compute[76442]:   <serial>7cee5223-982f-4854-9525-ec2947409772</serial>
Nov 14 20:37:28 user nova-compute[76442]: </disk>
Nov 14 20:37:28 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08c2a8c-3506-4def-9fd1-247dacbeb586]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba] added
Nov 14 20:37:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5405bc-536c-4a5a-a535-231cc1eb2258]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9555a39b-b1fd-4bd2-90ba-9c10f188ea12]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjREFufD {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjREFufD" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb263f5-4de5-4d3a-8f32-cda932d6bdac]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjREFufD'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[44abf63b-e57f-4722-8eec-eb2844052e06]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c276437f-9858-41f2-9cd4-9e5c4b0168e7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c2d1f-5039-4444-a987-b294780d5113]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba, portal: 172.16.0.220,3260]
Nov 14 20:37:28 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6440f2b-8cef-481a-818d-5ddab738a6c1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2ee56c-c53e-423e-8b99-7ba8f88a005c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9212ae11-b986-4fdd-aa5c-523b1cf6835e]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjREFufD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:37:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] No VIF found with MAC fa:16:3e:f8:3a:4e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:37:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d83ea166-c99e-47ca-b617-be1ef5e0fc99 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.120s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] <== connect_volume: return (2161ms) {'type': 'block', 'scsi_wwn': '26435663336643562', 'path': '/dev/sdj'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435663336643562', 'path': '/dev/sdj'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:37:29 user nova-compute[76442]: DEBUG nova.objects.instance [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lazy-loading 'flavor' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:37:29 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:29 user nova-compute[76442]:   <source dev="/dev/sdj"/>
Nov 14 20:37:29 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:29 user nova-compute[76442]:   <serial>58603e24-a805-4a91-bbc6-01a56fa367ba</serial>
Nov 14 20:37:29 user nova-compute[76442]: </disk>
Nov 14 20:37:29 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG os_brick.utils [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d016503d-162c-4677-9f46-a152c8d69004]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7feca84-fd1a-41dc-8cd4-7f0bccf24dfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[143c5865-0276-4f58-b480-567850f213d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[da19830e-8c9e-4f57-9d5c-6834ba9ca5ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:30 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc833f3-b303-41e9-878e-00d7f2b7e514]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG os_brick.utils [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] No BDM found with device name hda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] No VIF found with MAC fa:16:3e:18:ab:0a, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:37:30 user nova-compute[76442]: INFO nova.compute.manager [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Swapping volume 7cee5223-982f-4854-9525-ec2947409772 for 3a5cdb61-0012-4d82-bf59-d56dbe94c33a
Nov 14 20:37:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-39920403-c540-44d4-b73c-aed0844060c1 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.981s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:32 user nova-compute[76442]: INFO nova.compute.manager [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Detaching volume 58603e24-a805-4a91-bbc6-01a56fa367ba
Nov 14 20:37:32 user nova-compute[76442]: INFO nova.virt.block_device [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Attempting to driver detach volume 58603e24-a805-4a91-bbc6-01a56fa367ba from mountpoint /dev/vdb
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Attempting to detach device vdb from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:32 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:32 user nova-compute[76442]:   <source dev="/dev/sdj"/>
Nov 14 20:37:32 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:32 user nova-compute[76442]:   <serial>58603e24-a805-4a91-bbc6-01a56fa367ba</serial>
Nov 14 20:37:32 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 20:37:32 user nova-compute[76442]: </disk>
Nov 14 20:37:32 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:32 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Successfully detached device vdb from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 from the persistent domain config.
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:32 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:32 user nova-compute[76442]:   <source dev="/dev/sdj"/>
Nov 14 20:37:32 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:32 user nova-compute[76442]:   <serial>58603e24-a805-4a91-bbc6-01a56fa367ba</serial>
Nov 14 20:37:32 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 20:37:32 user nova-compute[76442]: </disk>
Nov 14 20:37:32 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-972f32a1-a49a-4505-b4d5-9fc1847cc23e req-b5efa8f5-b886-461d-96d4-821704d3de10 service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received event network-changed-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-972f32a1-a49a-4505-b4d5-9fc1847cc23e req-b5efa8f5-b886-461d-96d4-821704d3de10 service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Refreshing instance network info cache due to event network-changed-d83cd1ac-7bcb-41ab-9a52-1102818d6189. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-972f32a1-a49a-4505-b4d5-9fc1847cc23e req-b5efa8f5-b886-461d-96d4-821704d3de10 service nova] Acquiring lock "refresh_cache-2109949f-44c3-40d9-bed6-aef35fa5b8cd" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-972f32a1-a49a-4505-b4d5-9fc1847cc23e req-b5efa8f5-b886-461d-96d4-821704d3de10 service nova] Acquired lock "refresh_cache-2109949f-44c3-40d9-bed6-aef35fa5b8cd" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-972f32a1-a49a-4505-b4d5-9fc1847cc23e req-b5efa8f5-b886-461d-96d4-821704d3de10 service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Refreshing network info cache for port d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.objects.instance [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lazy-loading 'flavor' on Instance uuid 2109949f-44c3-40d9-bed6-aef35fa5b8cd {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-972f32a1-a49a-4505-b4d5-9fc1847cc23e req-b5efa8f5-b886-461d-96d4-821704d3de10 service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Updated VIF entry in instance network info cache for port d83cd1ac-7bcb-41ab-9a52-1102818d6189. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-972f32a1-a49a-4505-b4d5-9fc1847cc23e req-b5efa8f5-b886-461d-96d4-821704d3de10 service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Updating instance_info_cache with network_info: [{"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-972f32a1-a49a-4505-b4d5-9fc1847cc23e req-b5efa8f5-b886-461d-96d4-821704d3de10 service nova] Releasing lock "refresh_cache-2109949f-44c3-40d9-bed6-aef35fa5b8cd" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:32 user nova-compute[76442]: INFO nova.compute.manager [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Attaching volume 9d4342d4-766e-4c2e-834c-7c718b0270ce to /dev/vdb
Nov 14 20:37:33 user nova-compute[76442]: DEBUG os_brick.utils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b91f60-769c-4d23-b75f-508ab4f96d85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e6dea7-eea8-4a02-bab8-eab4deef014e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7765a9-b659-453e-bbdc-5acbf23c0e0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f941684d-d752-45a6-8321-9303b66368a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:33 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:37:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[16290823-7da2-4f4c-89df-c34040d61ec0]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG os_brick.utils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:33 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Updating existing volume attachment record: d0b39ac9-0766-4dff-98ec-42a0d1778343 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzLWtpIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '903f5659-0c6b-46c0-a3b1-02b8ada7154a', 'attached_at': '', 'detached_at': '', 'volume_id': '3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'serial': '3a5cdb61-0012-4d82-bf59-d56dbe94c33a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkujZiJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '903f5659-0c6b-46c0-a3b1-02b8ada7154a', 'attached_at': '', 'detached_at': '', 'volume_id': '7cee5223-982f-4854-9525-ec2947409772', 'serial'} {{(pid=76442) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzLWtpIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:35 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:35 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:35 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f2f3d-e1bf-4760-bc7d-20c1850e039a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:37:35 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[564f8443-d024-4773-8d23-fbbae7433d4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a] added
Nov 14 20:37:35 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[113746ad-8abb-49aa-a5ff-c6b5a9ebe60b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a30dab5-5ab1-4051-9664-d5abe88340f4]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzLWtpIm {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzLWtpIm" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ad1a46-f632-42fd-8d56-d6369377a864]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yzLWtpIm'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[975d95b6-9190-4595-9ee3-37b393178dc8]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641e34e-437b-48cd-a2f2-c35add24c3ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[22038b54-c706-485a-95f6-90563002f37b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a, portal: 172.16.0.220,3260]
Nov 14 20:37:35 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:35 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e2b7d3-985c-47fb-b8fa-9a20aa3ac312]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de0658-5988-4502-8f8a-b27afee1c00a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:35 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f211303-612e-44c7-adfe-5e099647e4da]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzLWtpIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:37:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:36 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:36 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23039353939356665', 'path': '/dev/sdk'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039353939356665', 'path': '/dev/sdk'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:37:36 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lazy-loading 'flavor' on Instance uuid 903f5659-0c6b-46c0-a3b1-02b8ada7154a {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 155189248 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 307232768 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBvnDlVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:38 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:38 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:38 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e18f5a-bc3c-486d-bd4c-1eadb24b4ed6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:37:38 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ddb7c4-1609-441c-85eb-4d641d847ad0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce] added
Nov 14 20:37:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32770f5-77a1-47f9-b3cc-a20ce65e9a9e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3418a62-1cd7-4241-a4ba-8078cf8a5b0c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBvnDlVm {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBvnDlVm" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad5bd1c-c5d4-4b4c-bef5-5a6f63451c3d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KBvnDlVm'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c89092-f8d2-4765-9b75-e58f1aa6929d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce1924b-f197-4724-9c27-70c52cc32919]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[85552754-1ea9-431d-9697-ec4bda9ab2d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce, portal: 172.16.0.220,3260]
Nov 14 20:37:38 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1c84e3-7781-473a-b6c8-17656b98beb0]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 467664896 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5654a050-05cc-4fb7-ac05-4b35f268b8a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d287a-69e0-4382-8c81-8511b221e7a9]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBvnDlVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:37:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 628097024 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 797966336 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26139366665633235', 'path': '/dev/sdl'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139366665633235', 'path': '/dev/sdl'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:37:39 user nova-compute[76442]: DEBUG nova.objects.instance [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lazy-loading 'flavor' on Instance uuid 2109949f-44c3-40d9-bed6-aef35fa5b8cd {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 20:37:39 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:39 user nova-compute[76442]:   <source dev="/dev/sdl"/>
Nov 14 20:37:39 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:39 user nova-compute[76442]:   <serial>9d4342d4-766e-4c2e-834c-7c718b0270ce</serial>
Nov 14 20:37:39 user nova-compute[76442]: </disk>
Nov 14 20:37:39 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 966787072 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] No VIF found with MAC fa:16:3e:3d:f4:bb, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91c2a137-3f07-4e4e-b0ff-950fb6050406 tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.444s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkujZiJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:40 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92d97ec6-0c90-48a6-a31e-737f262add2b tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] volume_snapshot_create: create_info: {'snapshot_id': 'b46025f0-02aa-4a9b-8bfd-e6807c204c9d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=76442) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92d97ec6-0c90-48a6-a31e-737f262add2b tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] snap xml: <domainsnapshot>
Nov 14 20:37:40 user nova-compute[76442]:   <disks>
Nov 14 20:37:40 user nova-compute[76442]:     <disk name="/dev/sdl" snapshot="external" type="file">
Nov 14 20:37:40 user nova-compute[76442]:       <source file="/dev/new_file"/>
Nov 14 20:37:40 user nova-compute[76442]:     </disk>
Nov 14 20:37:40 user nova-compute[76442]:     <disk name="vda" snapshot="no"/>
Nov 14 20:37:40 user nova-compute[76442]:   </disks>
Nov 14 20:37:40 user nova-compute[76442]: </domainsnapshot>
Nov 14 20:37:40 user nova-compute[76442]:  {{(pid=76442) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-92d97ec6-0c90-48a6-a31e-737f262add2b tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] Lazy-loading 'system_metadata' on Instance uuid 2109949f-44c3-40d9-bed6-aef35fa5b8cd {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[019fb784-528e-40ce-bc5b-31b62061d0c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:37:40 user nova-compute[76442]: No targets found.
Nov 14 20:37:40 user nova-compute[76442]: iSNS:
Nov 14 20:37:40 user nova-compute[76442]: No targets found.
Nov 14 20:37:40 user nova-compute[76442]: STATIC:
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:37:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:40 user nova-compute[76442]: FIRMWARE:
Nov 14 20:37:40 user nova-compute[76442]: No targets found.
Nov 14 20:37:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:37:40 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:37:40 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[12438ce9-d6df-4326-99c7-de3ae0e6951f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:40 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-92d97ec6-0c90-48a6-a31e-737f262add2b tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [None req-92d97ec6-0c90-48a6-a31e-737f262add2b tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     rv = execute(f, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     six.reraise(c, e, tb)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     raise value
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     rv = meth(*args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [None req-92d97ec6-0c90-48a6-a31e-737f262add2b tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     self._volume_snapshot_create(context, instance, guest,
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     rv = execute(f, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     six.reraise(c, e, tb)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     raise value
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     rv = meth(*args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] 
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[695b12b9-5c87-488c-8f31-e7099af97688]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e848ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772'): ({'sdi'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Removing single pathed devices sdi {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8a6b5f5a-76c6-41f8-8409-e13455274be9 tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] volume_snapshot_delete: delete_info: {'volume_id': '9d4342d4-766e-4c2e-834c-7c718b0270ce'} {{(pid=76442) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [None req-8a6b5f5a-76c6-41f8-8409-e13455274be9 tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd]     if delete_info['type'] != 'qcow2':
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] KeyError: 'type'
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] 
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d9b3c1-e807-4843-8410-f672a72b624d]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [None req-92d97ec6-0c90-48a6-a31e-737f262add2b tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b46025f0-02aa-4a9b-8bfd-e6807c204c9d could not be found.
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b46025f0-02aa-4a9b-8bfd-e6807c204c9d could not be found. (HTTP 404) (Request-ID: req-22ef7e96-26d3-4c79-95c5-a052faafb07a)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b46025f0-02aa-4a9b-8bfd-e6807c204c9d could not be found.
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a2126-3154-4324-9202-9d50ad907209]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Flushing IO for device /dev/sdi {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server [None req-92d97ec6-0c90-48a6-a31e-737f262add2b tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver [None req-8a6b5f5a-76c6-41f8-8409-e13455274be9 tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-11b725e8-f29d-42f1-aeb7-6a5c97b1e23f)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 20:37:40 user nova-compute[76442]: ERROR nova.virt.libvirt.driver 
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6a1b90-6aae-4778-90e6-2571eba8f96b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server [None req-8a6b5f5a-76c6-41f8-8409-e13455274be9 tempest-VolumesAssistedSnapshotsTest-999748958 tempest-VolumesAssistedSnapshotsTest-999748958-project] Exception during message handling: KeyError: 'type'
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 20:37:40 user nova-compute[76442]: ERROR oslo_messaging.rpc.server 
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51ddc86-ab99-4943-880e-cf09ef1fd106]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] SCSI volumes sdi have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c90dd8-88e4-4286-a6e9-7778a1287dbf]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd82bd8-ee43-4821-b4ae-6ea246b60d74]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260]
Nov 14 20:37:41 user nova-compute[76442]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea0033b-c1ae-4c18-9b47-e3246c45ae33]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] <== disconnect_volume: return (377ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzLWtpIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '903f5659-0c6b-46c0-a3b1-02b8ada7154a', 'attached_at': '', 'detached_at': '', 'volume_id': '3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'serial'} {{(pid=76442) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] swap_volume: removing Cinder connection for volume 7cee5223-982f-4854-9525-ec2947409772 {{(pid=76442) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:41 user nova-compute[76442]: INFO nova.compute.manager [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Detaching volume 9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:37:41 user nova-compute[76442]: INFO nova.virt.block_device [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Attempting to driver detach volume 9d4342d4-766e-4c2e-834c-7c718b0270ce from mountpoint /dev/vdb
Nov 14 20:37:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Attempting to detach device vdb from instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:41 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:41 user nova-compute[76442]:   <source dev="/dev/sdl"/>
Nov 14 20:37:41 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:41 user nova-compute[76442]:   <serial>9d4342d4-766e-4c2e-834c-7c718b0270ce</serial>
Nov 14 20:37:41 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:37:41 user nova-compute[76442]: </disk>
Nov 14 20:37:41 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Successfully detached device vdb from instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd from the persistent domain config.
Nov 14 20:37:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:41 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:41 user nova-compute[76442]:   <source dev="/dev/sdl"/>
Nov 14 20:37:41 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:41 user nova-compute[76442]:   <serial>9d4342d4-766e-4c2e-834c-7c718b0270ce</serial>
Nov 14 20:37:41 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:37:41 user nova-compute[76442]: </disk>
Nov 14 20:37:41 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] swap_volume: Updating volume 7cee5223-982f-4854-9525-ec2947409772 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "yzLWtpIm", "auth_password": "sWOF6BHJAqklC8", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "3a5cdb61-0012-4d82-bf59-d56dbe94c33a"}, "status": "reserved", "instance": "903f5659-0c6b-46c0-a3b1-02b8ada7154a", "attached_at": "", "detached_at": "", "volume_id": "3a5cdb61-0012-4d82-bf59-d56dbe94c33a", "serial": "3a5cdb61-0012-4d82-bf59-d56dbe94c33a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'no_device': None, 'attachment_id': '4b27ca06-05ce-4e0f-9aec-30be2ab08a5d'} {{(pid=76442) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 20:37:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f0746cb6-df30-4757-aca3-0f1e24166acb tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.741s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG os_brick.utils [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0aa5d6-4461-4eb1-b75b-e7e23dc6c0d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f48082-9b2b-43de-b544-a18c9454806c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae6fc21-299e-4b6e-8120-b00b8f2ea50c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[56db2e00-fc32-4574-b45e-fb49201f7e9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:42 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:37:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6fcb2b-ab7a-4007-aeb0-911a1734b079]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:37:42 user nova-compute[76442]: DEBUG os_brick.utils [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:42 user nova-compute[76442]: INFO nova.compute.manager [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Swapping volume 3a5cdb61-0012-4d82-bf59-d56dbe94c33a for 7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:37:44 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 is timed out.
Nov 14 20:37:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Successfully detached device vdb from instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 from the live domain config.
Nov 14 20:37:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtbqZerA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:44 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[069e3b0c-4912-4a77-810d-264f9a8b7dc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:37:44 user nova-compute[76442]: No targets found.
Nov 14 20:37:44 user nova-compute[76442]: iSNS:
Nov 14 20:37:44 user nova-compute[76442]: No targets found.
Nov 14 20:37:44 user nova-compute[76442]: STATIC:
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:37:44 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:44 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:44 user nova-compute[76442]: FIRMWARE:
Nov 14 20:37:44 user nova-compute[76442]: No targets found.
Nov 14 20:37:44 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:37:44 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:37:44 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91eda1d-9e74-4fc1-b704-4c8fb04d05a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7839dc13-397b-4b00-b5b6-d934e684eba9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:44 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4fc9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9'): ({'sdg'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Removing single pathed devices sdg {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b8efc-76ed-47d3-82a3-e85ee5e8f931]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bda7ce-6f0f-41a3-9be1-5745c5b44da6]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Flushing IO for device /dev/sdg {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.011s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9cf86f-9d91-4675-a4c7-7a5bdc97bcf6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a843ec6f-3e91-46bf-bc5b-ea72bcf66058]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] SCSI volumes sdg have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f846867-b587-49cd-82b6-8aef92c75152]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac85c20-e590-482e-869a-5c7c624deccd]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9, portal: 172.16.0.220,3260]
Nov 14 20:37:45 user nova-compute[76442]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:45 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abdc6957-283c-4de9-acb5-9e5835f683b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cde7201-ca5a-4cd6-af0d-a58d37cfe903]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] <== disconnect_volume: return (322ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:46 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 36d98f74-5652-445d-a06a-14b59aa3fa80 is timed out.
Nov 14 20:37:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Successfully detached device sdc from instance 36d98f74-5652-445d-a06a-14b59aa3fa80 from the live domain config.
Nov 14 20:37:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQYuRkPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:46 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c0af83-b6da-419f-bbb9-e054adf45c5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:37:46 user nova-compute[76442]: No targets found.
Nov 14 20:37:46 user nova-compute[76442]: iSNS:
Nov 14 20:37:46 user nova-compute[76442]: No targets found.
Nov 14 20:37:46 user nova-compute[76442]: STATIC:
Nov 14 20:37:46 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e
Nov 14 20:37:46 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:46 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:46 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495
Nov 14 20:37:46 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:46 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:46 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba
Nov 14 20:37:46 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:46 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:46 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667
Nov 14 20:37:46 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:46 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:46 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:37:46 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:46 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:46 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42
Nov 14 20:37:46 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:46 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:46 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a
Nov 14 20:37:46 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:46 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:46 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:37:46 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:46 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:46 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:37:46 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:46 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:46 user nova-compute[76442]: FIRMWARE:
Nov 14 20:37:46 user nova-compute[76442]: No targets found.
Nov 14 20:37:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:37:46 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:37:46 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[723dc2ce-4563-44b8-b7be-7f7217fbc55b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[236835c1-6848-4066-845e-f82a375c1252]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:46 user nova-compute[76442]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 (non-flash)
Nov 14 20:37:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e87939a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667'): ({'sdh'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Removing single pathed devices sdh {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b08b1f-1645-46f3-97fc-44994e4eed49]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8a14a-9e1d-4379-861b-7c262c6a61bf]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Flushing IO for device /dev/sdh {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[de59c7cf-653b-4195-89b5-1a51bd2a5300]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e85fce-bd8d-46a9-ba70-ae5c4c41e107]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] SCSI volumes sdh have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[10191af7-8e7c-412f-ae19-c6534972771c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b2de22-0a36-4fc1-a74d-3baea9b55f72]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667, portal: 172.16.0.220,3260]
Nov 14 20:37:46 user nova-compute[76442]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b08f0ad-ad3b-4c72-ad41-0b2c13f0a667 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc85afa9-1965-430d-9456-eb4d59a20b04]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] <== disconnect_volume: return (342ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:37:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lazy-loading 'flavor' on Instance uuid 36d98f74-5652-445d-a06a-14b59aa3fa80 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a1077dc9-e862-46bd-bc66-dd1648900f45 tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.678s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lazy-loading 'flavor' on Instance uuid 24c3abec-1233-45d1-a5ce-d5a14f76b313 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f40c29e6-1ce4-452b-b715-4c39911b4906 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.730s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkujZiJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '903f5659-0c6b-46c0-a3b1-02b8ada7154a', 'attached_at': '', 'detached_at': '', 'volume_id': '7cee5223-982f-4854-9525-ec2947409772', 'serial': '7cee5223-982f-4854-9525-ec2947409772'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzLWtpIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '3a5cdb61-0012-4d82-bf59-d56dbe94c33a'}, 'status': 'reserved', 'instance': '903f5659-0c6b-46c0-a3b1-02b8ada7154a', 'attached_at': '', 'detached_at': '', 'volume_id': '3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'serial'} {{(pid=76442) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkujZiJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:48 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:48 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:48 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[249eb887-6509-464b-a8d5-12402af30e23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:37:48 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3646e093-f97a-4f9b-afb2-e92588ab6bcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772] added
Nov 14 20:37:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[78be618a-f0a7-4c64-8aeb-cb9073a2ccd9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:48 user nova-compute[76442]: INFO nova.compute.manager [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Terminating instance
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a62bc5-2435-40e0-a00f-a8bf011ab5bf]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PkujZiJX {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PkujZiJX" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b409c26-93c5-4d5b-bf10-ab0a38d8d164]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PkujZiJX'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4de256-9a96-4386-a248-be8ddc1c29b4]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2130100f-1572-4b30-8c61-0a3579e03436]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[052e1e5a-d1f4-49d8-9ec1-175173bc1c42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260]
Nov 14 20:37:48 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec7f124-9ab3-4db3-8e8c-1d81a5cd8ef6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d050af-b253-4432-a568-74a7f406689f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:48 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] HCTL ('38', '-', '-', 0) found on session 14 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b890f3f-5447-4ea2-9f06-cdc49eb96039]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Searching for a device in session 14 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkujZiJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-edb39fb1-f044-4ae3-b2e6-cdfcdbf22656 req-85812161-ccf7-4e13-acce-5b3ada62865b service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received event network-vif-unplugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-edb39fb1-f044-4ae3-b2e6-cdfcdbf22656 req-85812161-ccf7-4e13-acce-5b3ada62865b service nova] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-edb39fb1-f044-4ae3-b2e6-cdfcdbf22656 req-85812161-ccf7-4e13-acce-5b3ada62865b service nova] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-edb39fb1-f044-4ae3-b2e6-cdfcdbf22656 req-85812161-ccf7-4e13-acce-5b3ada62865b service nova] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-edb39fb1-f044-4ae3-b2e6-cdfcdbf22656 req-85812161-ccf7-4e13-acce-5b3ada62865b service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] No waiting events found dispatching network-vif-unplugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-edb39fb1-f044-4ae3-b2e6-cdfcdbf22656 req-85812161-ccf7-4e13-acce-5b3ada62865b service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received event network-vif-unplugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:37:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Instance destroyed successfully.
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.objects.instance [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lazy-loading 'resources' on Instance uuid 36d98f74-5652-445d-a06a-14b59aa3fa80 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1117583019',display_name='tempest-AttachSCSIVolumeTestJSON-server-1117583019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1117583019',id=7,image_ref='464f0a50-254e-4c17-a79f-6f6ef3e7500d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjHqFQTr25/QezRNK9vi8w5D4A9tgjdzFHDHo5KRY15y5o7TZos5q+XKnZpgkHVg3j7FZy2QZbqbecM7PgpY5lgd2w2bypMpR20rS7FDIjAz0H4SFh4mRtSCBMgZGDf+A==',key_name='tempest-keypair-610964722',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dde59546f394a5a9da91dfbf0b887a5',ramdisk_id='',reservation_id='r-1q765cp5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='464f0a50-254e-4c17-a79f-6f6ef3e7500d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2030925873',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2030925873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='719ba1f189744fbda79093cdf7f4bbfa',uuid=36d98f74-5652-445d-a06a-14b59aa3fa80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Converting VIF {"id": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "address": "fa:16:3e:cf:4c:a3", "network": {"id": "55009253-dbe9-4a2d-b209-b0bea87f83a1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1401074595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dde59546f394a5a9da91dfbf0b887a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647bee4f-11", "ovs_interfaceid": "647bee4f-1167-49c0-9e8b-7d0fef7ebdf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=647bee4f-1167-49c0-9e8b-7d0fef7ebdf7,network=Network(55009253-dbe9-4a2d-b209-b0bea87f83a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bee4f-11') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG os_vif [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=647bee4f-1167-49c0-9e8b-7d0fef7ebdf7,network=Network(55009253-dbe9-4a2d-b209-b0bea87f83a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bee4f-11') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap647bee4f-11, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3b422f3-b597-4c5a-b57e-20e332a44f2b) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:49 user nova-compute[76442]: INFO os_vif [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:4c:a3,bridge_name='br-int',has_traffic_filtering=True,id=647bee4f-1167-49c0-9e8b-7d0fef7ebdf7,network=Network(55009253-dbe9-4a2d-b209-b0bea87f83a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647bee4f-11')
Nov 14 20:37:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Deleting instance files /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80_del
Nov 14 20:37:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Deletion of /opt/stack/data/nova/instances/36d98f74-5652-445d-a06a-14b59aa3fa80_del complete
Nov 14 20:37:49 user nova-compute[76442]: INFO nova.compute.manager [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 20:37:49 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23933643338623035', 'path': '/dev/sdg'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933643338623035', 'path': '/dev/sdg'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG nova.objects.instance [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lazy-loading 'flavor' on Instance uuid 903f5659-0c6b-46c0-a3b1-02b8ada7154a {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 77594624 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-29157776-38c3-4a55-a9e6-475f2d39a1c2 req-8ce073ee-9065-4ff4-89dd-d822b83971bd service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received event network-vif-plugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-29157776-38c3-4a55-a9e6-475f2d39a1c2 req-8ce073ee-9065-4ff4-89dd-d822b83971bd service nova] Acquiring lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-29157776-38c3-4a55-a9e6-475f2d39a1c2 req-8ce073ee-9065-4ff4-89dd-d822b83971bd service nova] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-29157776-38c3-4a55-a9e6-475f2d39a1c2 req-8ce073ee-9065-4ff4-89dd-d822b83971bd service nova] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-29157776-38c3-4a55-a9e6-475f2d39a1c2 req-8ce073ee-9065-4ff4-89dd-d822b83971bd service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] No waiting events found dispatching network-vif-plugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:50 user nova-compute[76442]: WARNING nova.compute.manager [req-29157776-38c3-4a55-a9e6-475f2d39a1c2 req-8ce073ee-9065-4ff4-89dd-d822b83971bd service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received unexpected event network-vif-plugged-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 for instance with vm_state active and task_state deleting.
Nov 14 20:37:50 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Took 1.55 seconds to deallocate network for instance.
Nov 14 20:37:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-54de9296-c9f7-4955-a44d-b021a17e3f93 req-2e760e7b-504f-46d1-96c9-d8147be8e4ae service nova] [instance: 36d98f74-5652-445d-a06a-14b59aa3fa80] Received event network-vif-deleted-647bee4f-1167-49c0-9e8b-7d0fef7ebdf7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 218103808 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:51 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Deleted allocations for instance 36d98f74-5652-445d-a06a-14b59aa3fa80
Nov 14 20:37:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-021ab379-7a61-4c66-bf04-02f7f38ffe8d tempest-AttachSCSIVolumeTestJSON-2030925873 tempest-AttachSCSIVolumeTestJSON-2030925873-project-member] Lock "36d98f74-5652-445d-a06a-14b59aa3fa80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.243s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 404750336 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:37:51 user nova-compute[76442]: INFO nova.compute.claims [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Claim successful on node user
Nov 14 20:37:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 581959680 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG nova.network.neutron [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:37:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:37:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:37:52 user nova-compute[76442]: INFO nova.virt.block_device [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Booting with blank volume at /dev/vda
Nov 14 20:37:52 user nova-compute[76442]: DEBUG nova.policy [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4163211b006c4fbbbdc575c0e6d02ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83568ed733848d09643843927ca0c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 744488960 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 is timed out.
Nov 14 20:37:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Successfully detached device vdb from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 from the live domain config.
Nov 14 20:37:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjREFufD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:52 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d673ef9-bb20-40d7-9510-c0b384698369]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:37:52 user nova-compute[76442]: No targets found.
Nov 14 20:37:52 user nova-compute[76442]: iSNS:
Nov 14 20:37:52 user nova-compute[76442]: No targets found.
Nov 14 20:37:52 user nova-compute[76442]: STATIC:
Nov 14 20:37:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e
Nov 14 20:37:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495
Nov 14 20:37:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba
Nov 14 20:37:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:37:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:37:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42
Nov 14 20:37:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a
Nov 14 20:37:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:37:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:37:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:52 user nova-compute[76442]: FIRMWARE:
Nov 14 20:37:52 user nova-compute[76442]: No targets found.
Nov 14 20:37:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:37:52 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:37:52 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8810f76-31f5-4057-bf01-27d41fbb92fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5009f6-92c5-4e02-8592-19ba68000b38]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:52 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4fcbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba'): ({'sdj'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Removing single pathed devices sdj {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cb07e6-c332-401f-bb6d-91cb5202ae01]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a75786-8df0-43e9-8ef8-1e0f2a5ef9f5]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Flushing IO for device /dev/sdj {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d03b68d-b9f3-4e4c-aa93-c77cebd19e16]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:37:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 910163968 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[235959a5-5754-49b0-9cc9-620c9c647a54]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] SCSI volumes sdj have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a115c5d-3cbe-49b1-9e7c-7628c3403f32]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[927cde5c-de74-44d6-b6f5-c268fcca967b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba, portal: 172.16.0.220,3260]
Nov 14 20:37:53 user nova-compute[76442]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58603e24-a805-4a91-bbc6-01a56fa367ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[743639e6-241c-452f-8e70-76ffd396ebd7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] <== disconnect_volume: return (466ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-c0f1478f-adff-4aab-a483-68eddf16115a req-858f6c4b-fa91-4cb1-bf4f-9f3160affba6 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-changed-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-c0f1478f-adff-4aab-a483-68eddf16115a req-858f6c4b-fa91-4cb1-bf4f-9f3160affba6 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing instance network info cache due to event network-changed-30298928-9818-41f6-a56d-0a5b574e138f. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c0f1478f-adff-4aab-a483-68eddf16115a req-858f6c4b-fa91-4cb1-bf4f-9f3160affba6 service nova] Acquiring lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c0f1478f-adff-4aab-a483-68eddf16115a req-858f6c4b-fa91-4cb1-bf4f-9f3160affba6 service nova] Acquired lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG nova.network.neutron [req-c0f1478f-adff-4aab-a483-68eddf16115a req-858f6c4b-fa91-4cb1-bf4f-9f3160affba6 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Refreshing network info cache for port 30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 1071644672 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:53 user nova-compute[76442]: DEBUG nova.network.neutron [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Successfully created port: f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzLWtpIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '3a5cdb61-0012-4d82-bf59-d56dbe94c33a'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:54 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lazy-loading 'flavor' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a823632d-1063-4389-bf84-0de363a4cad5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:37:54 user nova-compute[76442]: No targets found.
Nov 14 20:37:54 user nova-compute[76442]: iSNS:
Nov 14 20:37:54 user nova-compute[76442]: No targets found.
Nov 14 20:37:54 user nova-compute[76442]: STATIC:
Nov 14 20:37:54 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e
Nov 14 20:37:54 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:54 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:54 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495
Nov 14 20:37:54 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:54 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:54 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:37:54 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:54 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:54 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:37:54 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:54 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:54 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42
Nov 14 20:37:54 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:54 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:54 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a
Nov 14 20:37:54 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:54 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:54 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:37:54 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:54 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:54 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:37:54 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:54 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:54 user nova-compute[76442]: FIRMWARE:
Nov 14 20:37:54 user nova-compute[76442]: No targets found.
Nov 14 20:37:54 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:37:54 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:37:54 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.network.neutron [req-c0f1478f-adff-4aab-a483-68eddf16115a req-858f6c4b-fa91-4cb1-bf4f-9f3160affba6 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updated VIF entry in instance network info cache for port 30298928-9818-41f6-a56d-0a5b574e138f. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.network.neutron [req-c0f1478f-adff-4aab-a483-68eddf16115a req-858f6c4b-fa91-4cb1-bf4f-9f3160affba6 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [{"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b4805f-bd77-446c-895e-30a4000153cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9cf4cb2f-8e92-4ffd-907e-a9e47a492a1c tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.196s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c0f1478f-adff-4aab-a483-68eddf16115a req-858f6c4b-fa91-4cb1-bf4f-9f3160affba6 service nova] Releasing lock "refresh_cache-81e9fdfe-5853-4728-9618-d50ee80fa7fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b283b88-516a-43de-8a22-7b0b1b8193c1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:54 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:54 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:54 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4fed3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a'): ({'sdk'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Removing single pathed devices sdk {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d74f6ef-3351-43f3-b556-d7f43059362e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[44863db1-f84c-4604-a519-c03dce956c42]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Flushing IO for device /dev/sdk {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1601df78-ce49-4788-babb-8b8b6e437c53]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "interface-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-2ebe3f06-096a-47c4-b919-cae47e172d91" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "interface-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-2ebe3f06-096a-47c4-b919-cae47e172d91" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.objects.instance [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lazy-loading 'flavor' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1907993261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1907993261',id=8,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhiKJDZyTPUP42ifz5q1yPR2La2BoXPkYuIiGMuPResfJc+REH8acsUVh7+sZXo4dZ9+7k9ar1BYGHmzCSWGtVHpMzaDRVfYcUEnOUl+Cf9Cuyjn9931vx9cWZ5wDkQA==',key_name='tempest-keypair-1903225505',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19f15871cfc46a797bebbc7b4bd98c8',ramdisk_id='',reservation_id='r-ozgig145',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-882538911',owner_user_name='tempest-TaggedAttachmentsTest-882538911-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5cd68ca82b403894574c8cca866c0a',uuid=d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converting VIF {"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.066s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd0eac-c9e8-48ca-b8ba-c70af2c42e8d]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] SCSI volumes sdk have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface> {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface> {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Attempting to detach device tap2ebe3f06-09 from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] detach device xml: <interface type="ethernet">
Nov 14 20:37:54 user nova-compute[76442]:   <mac address="fa:16:3e:0f:d7:f1"/>
Nov 14 20:37:54 user nova-compute[76442]:   <model type="virtio"/>
Nov 14 20:37:54 user nova-compute[76442]:   <mtu size="1442"/>
Nov 14 20:37:54 user nova-compute[76442]:   <target dev="tap2ebe3f06-09"/>
Nov 14 20:37:54 user nova-compute[76442]: </interface>
Nov 14 20:37:54 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface> {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Successfully updated port: f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 20:37:54 user nova-compute[76442]:   <name>instance-00000008</name>
Nov 14 20:37:54 user nova-compute[76442]:   <uuid>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</uuid>
Nov 14 20:37:54 user nova-compute[76442]:   <metadata>
Nov 14 20:37:54 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:37:54 user nova-compute[76442]:   <nova:package version="0.0.0"/>
Nov 14 20:37:54 user nova-compute[76442]:   <nova:name>tempest-device-tagging-server-1907993261</nova:name>
Nov 14 20:37:54 user nova-compute[76442]:   <nova:creationTime>2023-11-14 20:37:21</nova:creationTime>
Nov 14 20:37:54 user nova-compute[76442]:   <nova:flavor name="m1.tiny">
Nov 14 20:37:54 user nova-compute[76442]:     <nova:memory>512</nova:memory>
Nov 14 20:37:54 user nova-compute[76442]:     <nova:disk>1</nova:disk>
Nov 14 20:37:54 user nova-compute[76442]:     <nova:swap>0</nova:swap>
Nov 14 20:37:54 user nova-compute[76442]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:37:54 user nova-compute[76442]:     <nova:vcpus>1</nova:vcpus>
Nov 14 20:37:54 user nova-compute[76442]:   </nova:flavor>
Nov 14 20:37:54 user nova-compute[76442]:   <nova:owner>
Nov 14 20:37:54 user nova-compute[76442]:     <nova:user uuid="ea5cd68ca82b403894574c8cca866c0a">tempest-TaggedAttachmentsTest-882538911-project-member</nova:user>
Nov 14 20:37:54 user nova-compute[76442]:     <nova:project uuid="d19f15871cfc46a797bebbc7b4bd98c8">tempest-TaggedAttachmentsTest-882538911</nova:project>
Nov 14 20:37:54 user nova-compute[76442]:   </nova:owner>
Nov 14 20:37:54 user nova-compute[76442]:   <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:37:54 user nova-compute[76442]:   <nova:ports>
Nov 14 20:37:54 user nova-compute[76442]:     <nova:port uuid="419e15ae-a9b1-4eab-b39e-40668ff94442">
Nov 14 20:37:54 user nova-compute[76442]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:37:54 user nova-compute[76442]:     </nova:port>
Nov 14 20:37:54 user nova-compute[76442]:     <nova:port uuid="2ebe3f06-096a-47c4-b919-cae47e172d91">
Nov 14 20:37:54 user nova-compute[76442]:       <nova:ip type="fixed" address="10.10.10.13" ipVersion="4"/>
Nov 14 20:37:54 user nova-compute[76442]:     </nova:port>
Nov 14 20:37:54 user nova-compute[76442]:   </nova:ports>
Nov 14 20:37:54 user nova-compute[76442]: </nova:instance>
Nov 14 20:37:54 user nova-compute[76442]:   </metadata>
Nov 14 20:37:54 user nova-compute[76442]:   <memory unit='KiB'>524288</memory>
Nov 14 20:37:54 user nova-compute[76442]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 20:37:54 user nova-compute[76442]:   <vcpu placement='static'>1</vcpu>
Nov 14 20:37:54 user nova-compute[76442]:   <resource>
Nov 14 20:37:54 user nova-compute[76442]:     <partition>/machine</partition>
Nov 14 20:37:54 user nova-compute[76442]:   </resource>
Nov 14 20:37:54 user nova-compute[76442]:   <sysinfo type='smbios'>
Nov 14 20:37:54 user nova-compute[76442]:     <system>
Nov 14 20:37:54 user nova-compute[76442]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 20:37:54 user nova-compute[76442]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 20:37:54 user nova-compute[76442]:       <entry name='version'>0.0.0</entry>
Nov 14 20:37:54 user nova-compute[76442]:       <entry name='serial'>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:37:54 user nova-compute[76442]:       <entry name='uuid'>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:37:54 user nova-compute[76442]:       <entry name='family'>Virtual Machine</entry>
Nov 14 20:37:54 user nova-compute[76442]:     </system>
Nov 14 20:37:54 user nova-compute[76442]:   </sysinfo>
Nov 14 20:37:54 user nova-compute[76442]:   <os>
Nov 14 20:37:54 user nova-compute[76442]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 20:37:54 user nova-compute[76442]:     <boot dev='hd'/>
Nov 14 20:37:54 user nova-compute[76442]:     <smbios mode='sysinfo'/>
Nov 14 20:37:54 user nova-compute[76442]:   </os>
Nov 14 20:37:54 user nova-compute[76442]:   <features>
Nov 14 20:37:54 user nova-compute[76442]:     <acpi/>
Nov 14 20:37:54 user nova-compute[76442]:     <apic/>
Nov 14 20:37:54 user nova-compute[76442]:     <vmcoreinfo state='on'/>
Nov 14 20:37:54 user nova-compute[76442]:   </features>
Nov 14 20:37:54 user nova-compute[76442]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 20:37:54 user nova-compute[76442]:     <model fallback='forbid'>Nehalem</model>
Nov 14 20:37:54 user nova-compute[76442]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 20:37:54 user nova-compute[76442]:     <feature policy='require' name='vme'/>
Nov 14 20:37:54 user nova-compute[76442]:     <feature policy='require' name='x2apic'/>
Nov 14 20:37:54 user nova-compute[76442]:     <feature policy='require' name='hypervisor'/>
Nov 14 20:37:54 user nova-compute[76442]:   </cpu>
Nov 14 20:37:54 user nova-compute[76442]:   <clock offset='utc'>
Nov 14 20:37:54 user nova-compute[76442]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 20:37:54 user nova-compute[76442]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 20:37:54 user nova-compute[76442]:     <timer name='hpet' present='no'/>
Nov 14 20:37:54 user nova-compute[76442]:   </clock>
Nov 14 20:37:54 user nova-compute[76442]:   <on_poweroff>destroy</on_poweroff>
Nov 14 20:37:54 user nova-compute[76442]:   <on_reboot>restart</on_reboot>
Nov 14 20:37:54 user nova-compute[76442]:   <on_crash>destroy</on_crash>
Nov 14 20:37:54 user nova-compute[76442]:   <devices>
Nov 14 20:37:54 user nova-compute[76442]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 20:37:54 user nova-compute[76442]:     <disk type='file' device='disk'>
Nov 14 20:37:54 user nova-compute[76442]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 20:37:54 user nova-compute[76442]:       <source file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk' index='2'/>
Nov 14 20:37:54 user nova-compute[76442]:       <backingStore type='file' index='3'>
Nov 14 20:37:54 user nova-compute[76442]:         <format type='raw'/>
Nov 14 20:37:54 user nova-compute[76442]:         <source file='/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6'/>
Nov 14 20:37:54 user nova-compute[76442]:         <backingStore/>
Nov 14 20:37:54 user nova-compute[76442]:       </backingStore>
Nov 14 20:37:54 user nova-compute[76442]:       <target dev='vda' bus='virtio'/>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='virtio-disk0'/>
Nov 14 20:37:54 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </disk>
Nov 14 20:37:54 user nova-compute[76442]:     <disk type='file' device='cdrom'>
Nov 14 20:37:54 user nova-compute[76442]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 20:37:54 user nova-compute[76442]:       <source file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.config' index='1'/>
Nov 14 20:37:54 user nova-compute[76442]:       <backingStore/>
Nov 14 20:37:54 user nova-compute[76442]:       <target dev='hda' bus='ide'/>
Nov 14 20:37:54 user nova-compute[76442]:       <readonly/>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='ide0-0-0'/>
Nov 14 20:37:54 user nova-compute[76442]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </disk>
Nov 14 20:37:54 user nova-compute[76442]:     <controller type='usb' index='0' model='none'>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='usb'/>
Nov 14 20:37:54 user nova-compute[76442]:     </controller>
Nov 14 20:37:54 user nova-compute[76442]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='pci.0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </controller>
Nov 14 20:37:54 user nova-compute[76442]:     <controller type='ide' index='0'>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='ide'/>
Nov 14 20:37:54 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 20:37:54 user nova-compute[76442]:     </controller>
Nov 14 20:37:54 user nova-compute[76442]:     <interface type='ethernet'>
Nov 14 20:37:54 user nova-compute[76442]:       <mac address='fa:16:3e:18:ab:0a'/>
Nov 14 20:37:54 user nova-compute[76442]:       <target dev='tap419e15ae-a9'/>
Nov 14 20:37:54 user nova-compute[76442]:       <model type='virtio'/>
Nov 14 20:37:54 user nova-compute[76442]:       <mtu size='1442'/>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='net0'/>
Nov 14 20:37:54 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </interface>
Nov 14 20:37:54 user nova-compute[76442]:     <interface type='ethernet'>
Nov 14 20:37:54 user nova-compute[76442]:       <mac address='fa:16:3e:0f:d7:f1'/>
Nov 14 20:37:54 user nova-compute[76442]:       <target dev='tap2ebe3f06-09'/>
Nov 14 20:37:54 user nova-compute[76442]:       <model type='virtio'/>
Nov 14 20:37:54 user nova-compute[76442]:       <mtu size='1442'/>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='net1'/>
Nov 14 20:37:54 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </interface>
Nov 14 20:37:54 user nova-compute[76442]:     <serial type='pty'>
Nov 14 20:37:54 user nova-compute[76442]:       <source path='/dev/pts/7'/>
Nov 14 20:37:54 user nova-compute[76442]:       <log file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log' append='off'/>
Nov 14 20:37:54 user nova-compute[76442]:       <target type='isa-serial' port='0'>
Nov 14 20:37:54 user nova-compute[76442]:         <model name='isa-serial'/>
Nov 14 20:37:54 user nova-compute[76442]:       </target>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='serial0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </serial>
Nov 14 20:37:54 user nova-compute[76442]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 20:37:54 user nova-compute[76442]:       <source path='/dev/pts/7'/>
Nov 14 20:37:54 user nova-compute[76442]:       <log file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log' append='off'/>
Nov 14 20:37:54 user nova-compute[76442]:       <target type='serial' port='0'/>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='serial0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </console>
Nov 14 20:37:54 user nova-compute[76442]:     <input type='mouse' bus='ps2'>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='input0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </input>
Nov 14 20:37:54 user nova-compute[76442]:     <input type='keyboard' bus='ps2'>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='input1'/>
Nov 14 20:37:54 user nova-compute[76442]:     </input>
Nov 14 20:37:54 user nova-compute[76442]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 20:37:54 user nova-compute[76442]:       <listen type='address' address='0.0.0.0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </graphics>
Nov 14 20:37:54 user nova-compute[76442]:     <audio id='1' type='none'/>
Nov 14 20:37:54 user nova-compute[76442]:     <video>
Nov 14 20:37:54 user nova-compute[76442]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='video0'/>
Nov 14 20:37:54 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </video>
Nov 14 20:37:54 user nova-compute[76442]:     <memballoon model='virtio'>
Nov 14 20:37:54 user nova-compute[76442]:       <stats period='10'/>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='balloon0'/>
Nov 14 20:37:54 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </memballoon>
Nov 14 20:37:54 user nova-compute[76442]:     <rng model='virtio'>
Nov 14 20:37:54 user nova-compute[76442]:       <backend model='random'>/dev/urandom</backend>
Nov 14 20:37:54 user nova-compute[76442]:       <alias name='rng0'/>
Nov 14 20:37:54 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 20:37:54 user nova-compute[76442]:     </rng>
Nov 14 20:37:54 user nova-compute[76442]:   </devices>
Nov 14 20:37:54 user nova-compute[76442]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 20:37:54 user nova-compute[76442]:     <label>libvirt-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</label>
Nov 14 20:37:54 user nova-compute[76442]:     <imagelabel>libvirt-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</imagelabel>
Nov 14 20:37:54 user nova-compute[76442]:   </seclabel>
Nov 14 20:37:54 user nova-compute[76442]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 20:37:54 user nova-compute[76442]:     <label>+64055:+108</label>
Nov 14 20:37:54 user nova-compute[76442]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 20:37:54 user nova-compute[76442]:   </seclabel>
Nov 14 20:37:54 user nova-compute[76442]: </domain>
Nov 14 20:37:54 user nova-compute[76442]:  {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 20:37:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Successfully detached device tap2ebe3f06-09 from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 from the persistent domain config.
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] (1/8): Attempting to detach device tap2ebe3f06-09 with device alias net1 from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] detach device xml: <interface type="ethernet">
Nov 14 20:37:54 user nova-compute[76442]:   <mac address="fa:16:3e:0f:d7:f1"/>
Nov 14 20:37:54 user nova-compute[76442]:   <model type="virtio"/>
Nov 14 20:37:54 user nova-compute[76442]:   <mtu size="1442"/>
Nov 14 20:37:54 user nova-compute[76442]:   <target dev="tap2ebe3f06-09"/>
Nov 14 20:37:54 user nova-compute[76442]: </interface>
Nov 14 20:37:54 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d5bb6b-0e50-48ed-a279-1f14ec3544a1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquired lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6871ab10-97a4-46dc-8c5c-60abea2bdfe1]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a, portal: 172.16.0.220,3260]
Nov 14 20:37:54 user nova-compute[76442]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:54 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a5cdb61-0012-4d82-bf59-d56dbe94c33a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5043fd-a392-4b2b-b232-ba66321507c3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] <== disconnect_volume: return (390ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkujZiJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '903f5659-0c6b-46c0-a3b1-02b8ada7154a', 'attached_at': '', 'detached_at': '', 'volume_id': '7cee5223-982f-4854-9525-ec2947409772', 'serial'} {{(pid=76442) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] swap_volume: removing Cinder connection for volume 3a5cdb61-0012-4d82-bf59-d56dbe94c33a {{(pid=76442) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Start waiting for the detach event from libvirt for device tap2ebe3f06-09 with device alias net1 for instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updating instance_info_cache with network_info: [{"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Releasing lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Instance network_info: |[{"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] swap_volume: Updating volume 3a5cdb61-0012-4d82-bf59-d56dbe94c33a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "PkujZiJX", "auth_password": "de5zDjC2M0np6u", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "7cee5223-982f-4854-9525-ec2947409772"}, "status": "reserved", "instance": "903f5659-0c6b-46c0-a3b1-02b8ada7154a", "attached_at": "", "detached_at": "", "volume_id": "7cee5223-982f-4854-9525-ec2947409772", "serial": "7cee5223-982f-4854-9525-ec2947409772"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7cee5223-982f-4854-9525-ec2947409772', 'no_device': None, 'attachment_id': '1ab970fc-2f18-4173-8fb9-795b4629ba33'} {{(pid=76442) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ecc3362f-64ee-4da9-a792-cdc1befd1575 tempest-TestVolumeSwap-1281299807 tempest-TestVolumeSwap-1281299807-project-admin] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.767s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-changed-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Refreshing instance network info cache due to event network-changed-f58fa4af-61f7-4485-8d7d-96666813d45a. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] Acquiring lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] Acquired lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Refreshing network info cache for port f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:55 user nova-compute[76442]: INFO nova.compute.manager [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Terminating instance
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updated VIF entry in instance network info cache for port f58fa4af-61f7-4485-8d7d-96666813d45a. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updating instance_info_cache with network_info: [{"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] Releasing lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-unplugged-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] No waiting events found dispatching network-vif-unplugged-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:55 user nova-compute[76442]: WARNING nova.compute.manager [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received unexpected event network-vif-unplugged-2ebe3f06-096a-47c4-b919-cae47e172d91 for instance with vm_state active and task_state None.
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-plugged-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] No waiting events found dispatching network-vif-plugged-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:55 user nova-compute[76442]: WARNING nova.compute.manager [req-71487106-38be-4e5b-8eb3-212ae4bf5357 req-04674e75-ddc7-469a-a3ea-98f5ceb77f12 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received unexpected event network-vif-plugged-2ebe3f06-096a-47c4-b919-cae47e172d91 for instance with vm_state active and task_state None.
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: INFO nova.compute.manager [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Detaching volume 7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: INFO nova.virt.block_device [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Attempting to driver detach volume 7cee5223-982f-4854-9525-ec2947409772 from mountpoint /dev/vdb
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Attempting to detach device vdb from instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:56 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:56 user nova-compute[76442]:   <source dev="/dev/sdg"/>
Nov 14 20:37:56 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:56 user nova-compute[76442]:   <serial>7cee5223-982f-4854-9525-ec2947409772</serial>
Nov 14 20:37:56 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:37:56 user nova-compute[76442]: </disk>
Nov 14 20:37:56 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Successfully detached device vdb from instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a from the persistent domain config.
Nov 14 20:37:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:37:56 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:37:56 user nova-compute[76442]:   <source dev="/dev/sdg"/>
Nov 14 20:37:56 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:37:56 user nova-compute[76442]:   <serial>7cee5223-982f-4854-9525-ec2947409772</serial>
Nov 14 20:37:56 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:37:56 user nova-compute[76442]: </disk>
Nov 14 20:37:56 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-1d2277cf-60fd-4adc-8bc9-a19033ed89f3 req-e16c79ec-bbeb-42ce-9211-c697a6112aef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1d2277cf-60fd-4adc-8bc9-a19033ed89f3 req-e16c79ec-bbeb-42ce-9211-c697a6112aef service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1d2277cf-60fd-4adc-8bc9-a19033ed89f3 req-e16c79ec-bbeb-42ce-9211-c697a6112aef service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1d2277cf-60fd-4adc-8bc9-a19033ed89f3 req-e16c79ec-bbeb-42ce-9211-c697a6112aef service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-1d2277cf-60fd-4adc-8bc9-a19033ed89f3 req-e16c79ec-bbeb-42ce-9211-c697a6112aef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-unplugged-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-1d2277cf-60fd-4adc-8bc9-a19033ed89f3 req-e16c79ec-bbeb-42ce-9211-c697a6112aef service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-30298928-9818-41f6-a56d-0a5b574e138f for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-a57944e9-249c-4af5-b76f-926ff18db028 req-5f0f8ed4-5b32-4401-9db3-b6be9655d319 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a57944e9-249c-4af5-b76f-926ff18db028 req-5f0f8ed4-5b32-4401-9db3-b6be9655d319 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a57944e9-249c-4af5-b76f-926ff18db028 req-5f0f8ed4-5b32-4401-9db3-b6be9655d319 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a57944e9-249c-4af5-b76f-926ff18db028 req-5f0f8ed4-5b32-4401-9db3-b6be9655d319 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-a57944e9-249c-4af5-b76f-926ff18db028 req-5f0f8ed4-5b32-4401-9db3-b6be9655d319 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-unplugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-a57944e9-249c-4af5-b76f-926ff18db028 req-5f0f8ed4-5b32-4401-9db3-b6be9655d319 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-unplugged-3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-3884676d-16e2-4ae9-ae67-f545426a2a28 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-3884676d-16e2-4ae9-ae67-f545426a2a28 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:57 user nova-compute[76442]: WARNING nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-3884676d-16e2-4ae9-ae67-f545426a2a28 for instance with vm_state active and task_state deleting.
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-unplugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:57 user nova-compute[76442]: WARNING nova.compute.manager [req-921926e5-b139-4dea-833d-cfa545afe608 req-73be34d2-6cbe-4fcb-900f-9f92fa3a2b6d service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd for instance with vm_state active and task_state deleting.
Nov 14 20:37:57 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Instance destroyed successfully.
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.objects.instance [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lazy-loading 'resources' on Instance uuid 81e9fdfe-5853-4728-9618-d50ee80fa7fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:71:a2,bridge_name='br-int',has_traffic_filtering=True,id=30298928-9818-41f6-a56d-0a5b574e138f,network=Network(ab9db1cd-35ad-4b93-8f42-c5e7898d8748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30298928-98') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:71:a2,bridge_name='br-int',has_traffic_filtering=True,id=30298928-9818-41f6-a56d-0a5b574e138f,network=Network(ab9db1cd-35ad-4b93-8f42-c5e7898d8748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30298928-98') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30298928-98, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc013667-fd9c-4044-8432-4b10de5b88a3) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: INFO os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:71:a2,bridge_name='br-int',has_traffic_filtering=True,id=30298928-9818-41f6-a56d-0a5b574e138f,network=Network(ab9db1cd-35ad-4b93-8f42-c5e7898d8748),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30298928-98')
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6f81cf9-1b2d-4626-9a1d-6799ecf54357,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f81cf9-1b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6f81cf9-1b2d-4626-9a1d-6799ecf54357,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f81cf9-1b') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6f81cf9-1b, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed569dcd-5289-441f-9b0f-c0b4444697f4) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: INFO os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:4e:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6f81cf9-1b2d-4626-9a1d-6799ecf54357,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb6f81cf9-1b')
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=3884676d-16e2-4ae9-ae67-f545426a2a28,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3884676d-16') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=3884676d-16e2-4ae9-ae67-f545426a2a28,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3884676d-16') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3884676d-16, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8df933d2-3b95-4414-8c1a-162c89c47f21) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: INFO os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=3884676d-16e2-4ae9-ae67-f545426a2a28,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3884676d-16')
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fe:bb,bridge_name='br-int',has_traffic_filtering=True,id=5480900f-7611-41fc-95d7-9ad901637d7a,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5480900f-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fe:bb,bridge_name='br-int',has_traffic_filtering=True,id=5480900f-7611-41fc-95d7-9ad901637d7a,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5480900f-76') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5480900f-76, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=055fdb29-e544-4faa-b8ad-7f12d3092bd8) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: INFO os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fe:bb,bridge_name='br-int',has_traffic_filtering=True,id=5480900f-7611-41fc-95d7-9ad901637d7a,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5480900f-76')
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0e:87,bridge_name='br-int',has_traffic_filtering=True,id=ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec295d3b-5e') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0e:87,bridge_name='br-int',has_traffic_filtering=True,id=ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec295d3b-5e') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec295d3b-5e, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.utils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc6d2be-70cf-44ba-8ad9-9ccec0af627e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a927b96-7bcf-402c-aa9c-571d70ac2cb9) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08a9d58-167b-4ceb-bbd4-caa1aef3dc50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdad086-9540-4ad3-84c3-2e196743d617]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37435ad-76c2-408d-8e98-2b99a97c5964]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: INFO os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0e:87,bridge_name='br-int',has_traffic_filtering=True,id=ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd,network=Network(c45b5d3e-34c0-45c0-8250-9ef36818e1e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec295d3b-5e')
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:16:cc,bridge_name='br-int',has_traffic_filtering=True,id=e3916fc6-9f0b-4f37-bd71-9e809b1e72a3,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3916fc6-9f') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:16:cc,bridge_name='br-int',has_traffic_filtering=True,id=e3916fc6-9f0b-4f37-bd71-9e809b1e72a3,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3916fc6-9f') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:37:58 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ebe6cc-b153-4be7-8a77-19317b8e323c]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.utils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updating existing volume attachment record: 1d34691d-1e44-4f59-a6ad-94c2b82f08db {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3916fc6-9f, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c05aa4d-c266-45be-9769-261f52b4b15a) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: INFO os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:16:cc,bridge_name='br-int',has_traffic_filtering=True,id=e3916fc6-9f0b-4f37-bd71-9e809b1e72a3,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3916fc6-9f')
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-882337732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-882337732',id=11,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwNxJcvMm4vCeq9Kui5m58OUgneJdnD0eHHv+ZC3pEtXO5AhHTZbPuIxbg1QF0FBHV4+fgF7yMX+5HU8HfJPEzCBVW6loZ3wHW1gGxXgLYLsLxfq9Zqz7rDbEyxXzpEHQ==',key_name='tempest-keypair-428754902',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:36:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dccb4e840f4141baab5c71494e39ece0',ramdisk_id='',reservation_id='r-ec2gv43h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1104592603',owner_user_name='tempest-TaggedBootDevicesTest_v242-1104592603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='271920a06b1747949cea79a6e815098e',uuid=81e9fdfe-5853-4728-9618-d50ee80fa7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converting VIF {"id": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "address": "fa:16:3e:56:f5:64", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf0a857-2d", "ovs_interfaceid": "abf0a857-2db3-47b1-9c43-0fd0aa2e3e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:f5:64,bridge_name='br-int',has_traffic_filtering=True,id=abf0a857-2db3-47b1-9c43-0fd0aa2e3e40,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0a857-2d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f5:64,bridge_name='br-int',has_traffic_filtering=True,id=abf0a857-2db3-47b1-9c43-0fd0aa2e3e40,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0a857-2d') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabf0a857-2d, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=072af9da-446d-4b0c-a145-b68d42a8e0dc) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:58 user nova-compute[76442]: WARNING nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-30298928-9818-41f6-a56d-0a5b574e138f for instance with vm_state active and task_state deleting.
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-unplugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:58 user nova-compute[76442]: WARNING nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-b6f81cf9-1b2d-4626-9a1d-6799ecf54357 for instance with vm_state active and task_state deleting.
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-unplugged-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-5480900f-7611-41fc-95d7-9ad901637d7a for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:58 user nova-compute[76442]: WARNING nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-5480900f-7611-41fc-95d7-9ad901637d7a for instance with vm_state active and task_state deleting.
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-unplugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-unplugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:58 user nova-compute[76442]: WARNING nova.compute.manager [req-fade7636-540f-4dfc-a544-4193fa924a2e req-2a41d5ca-0768-428a-803c-ff9447332a17 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 for instance with vm_state active and task_state deleting.
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:37:58 user nova-compute[76442]: INFO os_vif [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:f5:64,bridge_name='br-int',has_traffic_filtering=True,id=abf0a857-2db3-47b1-9c43-0fd0aa2e3e40,network=Network(42fbdb2a-beed-4343-82ba-539c5683e357),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf0a857-2d')
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ymrZfbjs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:58 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[325ac460-1f79-4dd5-ba68-a4f90a82d5f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:37:58 user nova-compute[76442]: No targets found.
Nov 14 20:37:58 user nova-compute[76442]: iSNS:
Nov 14 20:37:58 user nova-compute[76442]: No targets found.
Nov 14 20:37:58 user nova-compute[76442]: STATIC:
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: FIRMWARE:
Nov 14 20:37:58 user nova-compute[76442]: No targets found.
Nov 14 20:37:58 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:37:58 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:37:58 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b729813-1af6-449e-9d0b-42e2c0b2c69c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4836fa8e-1181-4bb6-b9dc-1146da89ae46]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4fcb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e1bf63-5292-4e60-97c0-97e816e4d4cc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e1c7b8-ea0f-4d69-99c2-c3c14bd96343]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0e24b5-3dfc-46fc-95b7-09c05a8e16ab]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef58571-4e32-4d22-bcd3-38c83ad362f0]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0727946-81e2-4b37-bca4-c47953b57f37]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc80474-f553-48e2-be6c-252cf44f003a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42, portal: 172.16.0.220,3260]
Nov 14 20:37:58 user nova-compute[76442]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:58 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe076475-7ca4-485f-b29e-911181ec6c42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfad71fe-72d2-4984-8c17-18b84bd165cd]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] <== disconnect_volume: return (340ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoFgkwVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:58 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a98087e-4987-4857-bfb7-000babff775a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:37:58 user nova-compute[76442]: No targets found.
Nov 14 20:37:58 user nova-compute[76442]: iSNS:
Nov 14 20:37:58 user nova-compute[76442]: No targets found.
Nov 14 20:37:58 user nova-compute[76442]: STATIC:
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:37:58 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:58 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:58 user nova-compute[76442]: FIRMWARE:
Nov 14 20:37:58 user nova-compute[76442]: No targets found.
Nov 14 20:37:58 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:37:58 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:37:58 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fbab71-9cd3-43b3-ab87-ad747f806c00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[39032b9a-b687-48c4-8806-b8958eb04ec7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:58 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:58 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0708340820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d388cb-ade3-4e0c-a9a8-84f0a3c7adf4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25d0163-3f61-4e6c-becf-0085a7843ffe]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee5355-a805-490f-9644-94d8243eebe0]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[146f03fc-d419-4e2b-975e-ffcd57d0a053]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:37:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[104c8c8c-5b61-4a39-bb4c-8dda3a360aa7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f5e6f-070f-46de-85d2-6a67062c4792]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495, portal: 172.16.0.220,3260]
Nov 14 20:37:59 user nova-compute[76442]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dde8b95b-78dc-40c8-8db9-05da1b79d495 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9010d0a2-5f66-4dfc-b9e3-04680c699c86]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] <== disconnect_volume: return (335ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-7a1a8163-cf62-4a8a-b7b2-7e1c503604e1 req-deed57f8-f850-4f6b-9da2-a0038d767cf4 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-plugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7a1a8163-cf62-4a8a-b7b2-7e1c503604e1 req-deed57f8-f850-4f6b-9da2-a0038d767cf4 service nova] Acquiring lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7a1a8163-cf62-4a8a-b7b2-7e1c503604e1 req-deed57f8-f850-4f6b-9da2-a0038d767cf4 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7a1a8163-cf62-4a8a-b7b2-7e1c503604e1 req-deed57f8-f850-4f6b-9da2-a0038d767cf4 service nova] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-7a1a8163-cf62-4a8a-b7b2-7e1c503604e1 req-deed57f8-f850-4f6b-9da2-a0038d767cf4 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] No waiting events found dispatching network-vif-plugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:37:59 user nova-compute[76442]: WARNING nova.compute.manager [req-7a1a8163-cf62-4a8a-b7b2-7e1c503604e1 req-deed57f8-f850-4f6b-9da2-a0038d767cf4 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received unexpected event network-vif-plugged-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 for instance with vm_state active and task_state deleting.
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEMthuSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:37:59 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9015c7e8-8b6d-4fe3-9cd6-b85f9e6b26b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:37:59 user nova-compute[76442]: No targets found.
Nov 14 20:37:59 user nova-compute[76442]: iSNS:
Nov 14 20:37:59 user nova-compute[76442]: No targets found.
Nov 14 20:37:59 user nova-compute[76442]: STATIC:
Nov 14 20:37:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e
Nov 14 20:37:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:37:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:37:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:37:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:37:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:37:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:37:59 user nova-compute[76442]: FIRMWARE:
Nov 14 20:37:59 user nova-compute[76442]: No targets found.
Nov 14 20:37:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:37:59 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:37:59 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c688036-6b47-4241-8867-235972ef2d16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[448e8d78-a16c-423e-a74a-8a789ffe8332]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:59 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:59 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:59 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:59 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:37:59 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:37:59 user nova-compute[76442]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e (non-flash)
Nov 14 20:37:59 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:37:59 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:37:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e848b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7090ffa1-be33-4c9e-af69-8c686535019c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fc71a5-5be9-4ef1-a9ce-fd70cd839069]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cace89-5c95-4d2e-a74a-3fa5a99c4b7a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f9726e-a6e2-43d2-a553-f95a81a50779]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5411c55-cc29-4e97-82d7-f1bf52608df2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Updating instance_info_cache with network_info: [{"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2865094-be0e-4245-b3a4-5ebd84daf18b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e, portal: 172.16.0.220,3260]
Nov 14 20:37:59 user nova-compute[76442]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e, portal: 172.16.0.220,3260] successful.
Nov 14 20:37:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-da018992-79f4-4db3-bbf7-a492508ff629" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b59af4-5483-4bba-af4f-0c8e3216222e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddd4fae-f7c3-4f3b-9bfb-633e53499815]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] <== disconnect_volume: return (336ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:37:59 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Deleting instance files /opt/stack/data/nova/instances/81e9fdfe-5853-4728-9618-d50ee80fa7fb_del
Nov 14 20:37:59 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Deletion of /opt/stack/data/nova/instances/81e9fdfe-5853-4728-9618-d50ee80fa7fb_del complete
Nov 14 20:37:59 user nova-compute[76442]: INFO nova.compute.manager [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Took 3.74 seconds to destroy the instance on the hypervisor.
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:37:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-5f644ab2-10a1-479d-8a70-0a2d53a01b41 req-e908925b-0d8a-451a-b4d7-6eda2734f9f1 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-deleted-abf0a857-2db3-47b1-9c43-0fd0aa2e3e40 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:01 user nova-compute[76442]: INFO nova.compute.manager [req-5f644ab2-10a1-479d-8a70-0a2d53a01b41 req-e908925b-0d8a-451a-b4d7-6eda2734f9f1 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Neutron deleted interface abf0a857-2db3-47b1-9c43-0fd0aa2e3e40; detaching it from the instance and deleting it from the info cache
Nov 14 20:38:01 user nova-compute[76442]: DEBUG nova.network.neutron [req-5f644ab2-10a1-479d-8a70-0a2d53a01b41 req-e908925b-0d8a-451a-b4d7-6eda2734f9f1 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [{"id": "30298928-9818-41f6-a56d-0a5b574e138f", "address": "fa:16:3e:5c:71:a2", "network": {"id": "ab9db1cd-35ad-4b93-8f42-c5e7898d8748", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1168624033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30298928-98", "ovs_interfaceid": "30298928-9818-41f6-a56d-0a5b574e138f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "address": "fa:16:3e:85:4e:8c", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f81cf9-1b", "ovs_interfaceid": "b6f81cf9-1b2d-4626-9a1d-6799ecf54357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3884676d-16e2-4ae9-ae67-f545426a2a28", "address": "fa:16:3e:cd:af:8a", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3884676d-16", "ovs_interfaceid": "3884676d-16e2-4ae9-ae67-f545426a2a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5480900f-7611-41fc-95d7-9ad901637d7a", "address": "fa:16:3e:5a:fe:bb", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5480900f-76", "ovs_interfaceid": "5480900f-7611-41fc-95d7-9ad901637d7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "address": "fa:16:3e:7e:0e:87", "network": {"id": "c45b5d3e-34c0-45c0-8250-9ef36818e1e9", "bridge": "br-int", "label": "tempest-device-tagging-net1-603670772", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec295d3b-5e", "ovs_interfaceid": "ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "address": "fa:16:3e:4d:16:cc", "network": {"id": "42fbdb2a-beed-4343-82ba-539c5683e357", "bridge": "br-int", "label": "tempest-device-tagging-net2-2143206775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dccb4e840f4141baab5c71494e39ece0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3916fc6-9f", "ovs_interfaceid": "e3916fc6-9f0b-4f37-bd71-9e809b1e72a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-5f644ab2-10a1-479d-8a70-0a2d53a01b41 req-e908925b-0d8a-451a-b4d7-6eda2734f9f1 service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Detach interface failed, port_id=abf0a857-2db3-47b1-9c43-0fd0aa2e3e40, reason: Instance 81e9fdfe-5853-4728-9618-d50ee80fa7fb could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd is timed out.
Nov 14 20:38:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Successfully detached device vdb from instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd from the live domain config.
Nov 14 20:38:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBvnDlVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:38:01 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc4ba1c-e37c-4c31-88fa-90b4b47623e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:38:01 user nova-compute[76442]: No targets found.
Nov 14 20:38:01 user nova-compute[76442]: iSNS:
Nov 14 20:38:01 user nova-compute[76442]: No targets found.
Nov 14 20:38:01 user nova-compute[76442]: STATIC:
Nov 14 20:38:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:38:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:38:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:38:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:38:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:38:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:38:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce
Nov 14 20:38:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:38:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:38:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:38:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:38:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:38:01 user nova-compute[76442]: FIRMWARE:
Nov 14 20:38:01 user nova-compute[76442]: No targets found.
Nov 14 20:38:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:38:01 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:38:01 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[af55eba3-d22d-4fcc-8e5d-589b86f0ecc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dedb671-fb7a-4623-96dc-6e0f971c49fa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:38:01 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:38:01 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:01 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce (non-flash)
Nov 14 20:38:01 user nova-compute[76442]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:38:01 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:01 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e8161360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce'): ({'sdl'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Removing single pathed devices sdl {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[543220fe-1571-4c8c-bbb8-86a1fbad1857]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[784ff450-41d5-4025-bd6f-c0b3c8a46a58]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Flushing IO for device /dev/sdl {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b477893b-7e26-4fa2-b442-af2dec9f01a8]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:38:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.036s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[157089d4-2e30-43b8-98f9-c0c18f251433]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] SCSI volumes sdl have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbb8a22-0a44-4a26-92b5-bf68e1fa9520]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d043c649-3619-4372-8f5a-b72406c99d02]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce, portal: 172.16.0.220,3260]
Nov 14 20:38:02 user nova-compute[76442]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce, portal: 172.16.0.220,3260] successful.
Nov 14 20:38:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d4342d4-766e-4c2e-834c-7c718b0270ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d876d1ce-d3e1-4792-9558-e24a3ceac8df]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] <== disconnect_volume: return (401ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:02 user nova-compute[76442]: DEBUG nova.objects.instance [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lazy-loading 'flavor' on Instance uuid 2109949f-44c3-40d9-bed6-aef35fa5b8cd {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-44b5ce54-9046-49b1-ae47-0a6160dc407a tempest-VolumesAssistedSnapshotsTest-1048949586 tempest-VolumesAssistedSnapshotsTest-1048949586-project-admin] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.872s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:03 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Took 4.20 seconds to deallocate network for instance.
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-9b20e393-bc77-48ac-8f48-2e201483bf9a req-3325b840-51ed-4277-9713-11d30b98740c service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-deleted-ec295d3b-5e0b-4e2e-9c6c-a6fae73052bd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-9b20e393-bc77-48ac-8f48-2e201483bf9a req-3325b840-51ed-4277-9713-11d30b98740c service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-deleted-e3916fc6-9f0b-4f37-bd71-9e809b1e72a3 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-9b20e393-bc77-48ac-8f48-2e201483bf9a req-3325b840-51ed-4277-9713-11d30b98740c service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-deleted-5480900f-7611-41fc-95d7-9ad901637d7a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-9b20e393-bc77-48ac-8f48-2e201483bf9a req-3325b840-51ed-4277-9713-11d30b98740c service nova] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Received event network-vif-deleted-30298928-9818-41f6-a56d-0a5b574e138f {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:03 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:38:03 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=25.394691467285156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:38:03 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Creating image(s)
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Ensure instance console log exists: /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Start _get_guest_xml network_info=[{"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLFkYdUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5253f642-7c49-4c03-8d13-5105497b4f5d', 'attached_at': '', 'detached_at': '', 'volume_id': '2f1e11e0-aaef-47a6-ac09-77d6960195d6', 'serial': '2f1e11e0-aaef-47a6-ac09-77d6960195d6'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '1d34691d-1e44-4f59-a6ad-94c2b82f08db', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance da018992-79f4-4db3-bbf7-a492508ff629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 81e9fdfe-5853-4728-9618-d50ee80fa7fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5f080799-d27b-4765-b4fd-5842bae26067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:38:03 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:38:03 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLFkYdUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:38:03 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:38:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:38:03 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:38:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:38:03 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[911c8275-264f-496a-acb6-8f21700b2fd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:38:03 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fc83e2-baa3-4fe8-bf0f-30a560ce8f91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6] added
Nov 14 20:38:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c78659a-986c-404c-ad0f-6f9bd3caaf66]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c9bfc6-06a8-4e95-a3d3-a5486de5db81]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLFkYdUM {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLFkYdUM" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8657222a-e818-4361-b196-9a3bbb95052e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qLFkYdUM'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0750cb55-709b-45ed-930a-7548afbd733e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b03f7d5-d90d-4a01-a41a-49520beff7f4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6e9784-8450-492b-acc7-f619729e76be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6, portal: 172.16.0.220,3260]
Nov 14 20:38:04 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6, portal: 172.16.0.220,3260] successful.
Nov 14 20:38:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a938004e-afed-4543-819e-b1b91c0912d6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[56332a86-62b8-4e7b-9beb-66e4e2b0ca36]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:04 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6866aec-6a49-4bc3-be53-e005cc15db3a]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLFkYdUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:38:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23131373563613739', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131373563613739', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-408016581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-408016581',id=13,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-gtus977f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:37:52Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=5253f642-7c49-4c03-8d13-5105497b4f5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:28:05,bridge_name='br-int',has_traffic_filtering=True,id=f58fa4af-61f7-4485-8d7d-96666813d45a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58fa4af-61') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.objects.instance [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'pci_devices' on Instance uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:38:05 user nova-compute[76442]:   <uuid>5253f642-7c49-4c03-8d13-5105497b4f5d</uuid>
Nov 14 20:38:05 user nova-compute[76442]:   <name>instance-0000000d</name>
Nov 14 20:38:05 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:38:05 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:38:05 user nova-compute[76442]:   <metadata>
Nov 14 20:38:05 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:38:05 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:38:05 user nova-compute[76442]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-408016581</nova:name>
Nov 14 20:38:05 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:38:03</nova:creationTime>
Nov 14 20:38:05 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:38:05 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:38:05 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:38:05 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:38:05 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:38:05 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:38:05 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:38:05 user nova-compute[76442]:       <nova:owner>
Nov 14 20:38:05 user nova-compute[76442]:         <nova:user uuid="4163211b006c4fbbbdc575c0e6d02ac8">tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member</nova:user>
Nov 14 20:38:05 user nova-compute[76442]:         <nova:project uuid="f83568ed733848d09643843927ca0c42">tempest-ServerBootFromVolumeStableRescueTest-1547619353</nova:project>
Nov 14 20:38:05 user nova-compute[76442]:       </nova:owner>
Nov 14 20:38:05 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:38:05 user nova-compute[76442]:       <nova:ports>
Nov 14 20:38:05 user nova-compute[76442]:         <nova:port uuid="f58fa4af-61f7-4485-8d7d-96666813d45a">
Nov 14 20:38:05 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 20:38:05 user nova-compute[76442]:         </nova:port>
Nov 14 20:38:05 user nova-compute[76442]:       </nova:ports>
Nov 14 20:38:05 user nova-compute[76442]:     </nova:instance>
Nov 14 20:38:05 user nova-compute[76442]:   </metadata>
Nov 14 20:38:05 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:38:05 user nova-compute[76442]:     <system>
Nov 14 20:38:05 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:38:05 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:38:05 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:38:05 user nova-compute[76442]:       <entry name="serial">5253f642-7c49-4c03-8d13-5105497b4f5d</entry>
Nov 14 20:38:05 user nova-compute[76442]:       <entry name="uuid">5253f642-7c49-4c03-8d13-5105497b4f5d</entry>
Nov 14 20:38:05 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:38:05 user nova-compute[76442]:     </system>
Nov 14 20:38:05 user nova-compute[76442]:   </sysinfo>
Nov 14 20:38:05 user nova-compute[76442]:   <os>
Nov 14 20:38:05 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:38:05 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:38:05 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:38:05 user nova-compute[76442]:   </os>
Nov 14 20:38:05 user nova-compute[76442]:   <features>
Nov 14 20:38:05 user nova-compute[76442]:     <acpi/>
Nov 14 20:38:05 user nova-compute[76442]:     <apic/>
Nov 14 20:38:05 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:38:05 user nova-compute[76442]:   </features>
Nov 14 20:38:05 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:38:05 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:38:05 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:38:05 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:38:05 user nova-compute[76442]:   </clock>
Nov 14 20:38:05 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:38:05 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:38:05 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:38:05 user nova-compute[76442]:   </cpu>
Nov 14 20:38:05 user nova-compute[76442]:   <devices>
Nov 14 20:38:05 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:38:05 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:38:05 user nova-compute[76442]:       <source dev="/dev/sdb"/>
Nov 14 20:38:05 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:38:05 user nova-compute[76442]:       <serial>2f1e11e0-aaef-47a6-ac09-77d6960195d6</serial>
Nov 14 20:38:05 user nova-compute[76442]:     </disk>
Nov 14 20:38:05 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:38:05 user nova-compute[76442]:       <mac address="fa:16:3e:fa:28:05"/>
Nov 14 20:38:05 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:38:05 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:38:05 user nova-compute[76442]:       <target dev="tapf58fa4af-61"/>
Nov 14 20:38:05 user nova-compute[76442]:     </interface>
Nov 14 20:38:05 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:38:05 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/console.log" append="off"/>
Nov 14 20:38:05 user nova-compute[76442]:     </serial>
Nov 14 20:38:05 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:38:05 user nova-compute[76442]:     <video>
Nov 14 20:38:05 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:38:05 user nova-compute[76442]:     </video>
Nov 14 20:38:05 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:38:05 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:38:05 user nova-compute[76442]:     </rng>
Nov 14 20:38:05 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:38:05 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:38:05 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:38:05 user nova-compute[76442]:     </memballoon>
Nov 14 20:38:05 user nova-compute[76442]:   </devices>
Nov 14 20:38:05 user nova-compute[76442]: </domain>
Nov 14 20:38:05 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-408016581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-408016581',id=13,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-gtus977f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:37:52Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=5253f642-7c49-4c03-8d13-5105497b4f5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:28:05,bridge_name='br-int',has_traffic_filtering=True,id=f58fa4af-61f7-4485-8d7d-96666813d45a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58fa4af-61') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG os_vif [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:28:05,bridge_name='br-int',has_traffic_filtering=True,id=f58fa4af-61f7-4485-8d7d-96666813d45a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58fa4af-61') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b802f8c-457c-59e2-8631-50039a8c63f0', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf58fa4af-61, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf58fa4af-61, col_values=(('qos', UUID('6e74cc66-25f0-42f7-8e1b-a6e5cae7b520')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf58fa4af-61, col_values=(('external_ids', {'iface-id': 'f58fa4af-61f7-4485-8d7d-96666813d45a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:28:05', 'vm-uuid': '5253f642-7c49-4c03-8d13-5105497b4f5d'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:05 user nova-compute[76442]: INFO os_vif [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:28:05,bridge_name='br-int',has_traffic_filtering=True,id=f58fa4af-61f7-4485-8d7d-96666813d45a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58fa4af-61')
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:38:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No VIF found with MAC fa:16:3e:fa:28:05, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:38:06 user nova-compute[76442]: INFO nova.compute.manager [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] [instance: 81e9fdfe-5853-4728-9618-d50ee80fa7fb] Took 2.29 seconds to detach 3 volumes for instance.
Nov 14 20:38:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:06 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Deleted allocations for instance 81e9fdfe-5853-4728-9618-d50ee80fa7fb
Nov 14 20:38:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cfea699d-2a43-44d4-8fa9-f0034d2818c1 tempest-TaggedBootDevicesTest_v242-1104592603 tempest-TaggedBootDevicesTest_v242-1104592603-project-member] Lock "81e9fdfe-5853-4728-9618-d50ee80fa7fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.824s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-b27f4a56-818c-4b15-a40f-e7c162a34aed req-7b2cf3ac-d2dd-4f3a-addf-9339316df9cb service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b27f4a56-818c-4b15-a40f-e7c162a34aed req-7b2cf3ac-d2dd-4f3a-addf-9339316df9cb service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b27f4a56-818c-4b15-a40f-e7c162a34aed req-7b2cf3ac-d2dd-4f3a-addf-9339316df9cb service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b27f4a56-818c-4b15-a40f-e7c162a34aed req-7b2cf3ac-d2dd-4f3a-addf-9339316df9cb service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-b27f4a56-818c-4b15-a40f-e7c162a34aed req-7b2cf3ac-d2dd-4f3a-addf-9339316df9cb service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:06 user nova-compute[76442]: WARNING nova.compute.manager [req-b27f4a56-818c-4b15-a40f-e7c162a34aed req-7b2cf3ac-d2dd-4f3a-addf-9339316df9cb service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state building and task_state spawning.
Nov 14 20:38:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:38:08 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Instance spawned successfully.
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:08 user nova-compute[76442]: INFO nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-84c33089-1aaf-49f2-85eb-fd2d9cc9199d req-9fc43d50-33f4-4f89-814b-d1b11e9e97d8 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-84c33089-1aaf-49f2-85eb-fd2d9cc9199d req-9fc43d50-33f4-4f89-814b-d1b11e9e97d8 service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-84c33089-1aaf-49f2-85eb-fd2d9cc9199d req-9fc43d50-33f4-4f89-814b-d1b11e9e97d8 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-84c33089-1aaf-49f2-85eb-fd2d9cc9199d req-9fc43d50-33f4-4f89-814b-d1b11e9e97d8 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-84c33089-1aaf-49f2-85eb-fd2d9cc9199d req-9fc43d50-33f4-4f89-814b-d1b11e9e97d8 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:08 user nova-compute[76442]: WARNING nova.compute.manager [req-84c33089-1aaf-49f2-85eb-fd2d9cc9199d req-9fc43d50-33f4-4f89-814b-d1b11e9e97d8 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state building and task_state spawning.
Nov 14 20:38:08 user nova-compute[76442]: INFO nova.compute.manager [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Took 17.48 seconds to build instance.
Nov 14 20:38:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-649f9394-9d01-4951-b977-0ec7e26b153a tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.617s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:14 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Waiting for libvirt event about the detach of device tap2ebe3f06-09 with device alias net1 from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 is timed out.
Nov 14 20:38:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface> {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 20:38:14 user nova-compute[76442]:   <name>instance-00000008</name>
Nov 14 20:38:14 user nova-compute[76442]:   <uuid>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</uuid>
Nov 14 20:38:14 user nova-compute[76442]:   <metadata>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:38:14 user nova-compute[76442]:   <nova:package version="0.0.0"/>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:name>tempest-device-tagging-server-1907993261</nova:name>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:creationTime>2023-11-14 20:37:21</nova:creationTime>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:flavor name="m1.tiny">
Nov 14 20:38:14 user nova-compute[76442]:     <nova:memory>512</nova:memory>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:disk>1</nova:disk>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:swap>0</nova:swap>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:vcpus>1</nova:vcpus>
Nov 14 20:38:14 user nova-compute[76442]:   </nova:flavor>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:owner>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:user uuid="ea5cd68ca82b403894574c8cca866c0a">tempest-TaggedAttachmentsTest-882538911-project-member</nova:user>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:project uuid="d19f15871cfc46a797bebbc7b4bd98c8">tempest-TaggedAttachmentsTest-882538911</nova:project>
Nov 14 20:38:14 user nova-compute[76442]:   </nova:owner>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:ports>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:port uuid="419e15ae-a9b1-4eab-b39e-40668ff94442">
Nov 14 20:38:14 user nova-compute[76442]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:38:14 user nova-compute[76442]:     </nova:port>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:port uuid="2ebe3f06-096a-47c4-b919-cae47e172d91">
Nov 14 20:38:14 user nova-compute[76442]:       <nova:ip type="fixed" address="10.10.10.13" ipVersion="4"/>
Nov 14 20:38:14 user nova-compute[76442]:     </nova:port>
Nov 14 20:38:14 user nova-compute[76442]:   </nova:ports>
Nov 14 20:38:14 user nova-compute[76442]: </nova:instance>
Nov 14 20:38:14 user nova-compute[76442]:   </metadata>
Nov 14 20:38:14 user nova-compute[76442]:   <memory unit='KiB'>524288</memory>
Nov 14 20:38:14 user nova-compute[76442]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 20:38:14 user nova-compute[76442]:   <vcpu placement='static'>1</vcpu>
Nov 14 20:38:14 user nova-compute[76442]:   <resource>
Nov 14 20:38:14 user nova-compute[76442]:     <partition>/machine</partition>
Nov 14 20:38:14 user nova-compute[76442]:   </resource>
Nov 14 20:38:14 user nova-compute[76442]:   <sysinfo type='smbios'>
Nov 14 20:38:14 user nova-compute[76442]:     <system>
Nov 14 20:38:14 user nova-compute[76442]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 20:38:14 user nova-compute[76442]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 20:38:14 user nova-compute[76442]:       <entry name='version'>0.0.0</entry>
Nov 14 20:38:14 user nova-compute[76442]:       <entry name='serial'>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:38:14 user nova-compute[76442]:       <entry name='uuid'>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:38:14 user nova-compute[76442]:       <entry name='family'>Virtual Machine</entry>
Nov 14 20:38:14 user nova-compute[76442]:     </system>
Nov 14 20:38:14 user nova-compute[76442]:   </sysinfo>
Nov 14 20:38:14 user nova-compute[76442]:   <os>
Nov 14 20:38:14 user nova-compute[76442]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 20:38:14 user nova-compute[76442]:     <boot dev='hd'/>
Nov 14 20:38:14 user nova-compute[76442]:     <smbios mode='sysinfo'/>
Nov 14 20:38:14 user nova-compute[76442]:   </os>
Nov 14 20:38:14 user nova-compute[76442]:   <features>
Nov 14 20:38:14 user nova-compute[76442]:     <acpi/>
Nov 14 20:38:14 user nova-compute[76442]:     <apic/>
Nov 14 20:38:14 user nova-compute[76442]:     <vmcoreinfo state='on'/>
Nov 14 20:38:14 user nova-compute[76442]:   </features>
Nov 14 20:38:14 user nova-compute[76442]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 20:38:14 user nova-compute[76442]:     <model fallback='forbid'>Nehalem</model>
Nov 14 20:38:14 user nova-compute[76442]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 20:38:14 user nova-compute[76442]:     <feature policy='require' name='vme'/>
Nov 14 20:38:14 user nova-compute[76442]:     <feature policy='require' name='x2apic'/>
Nov 14 20:38:14 user nova-compute[76442]:     <feature policy='require' name='hypervisor'/>
Nov 14 20:38:14 user nova-compute[76442]:   </cpu>
Nov 14 20:38:14 user nova-compute[76442]:   <clock offset='utc'>
Nov 14 20:38:14 user nova-compute[76442]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 20:38:14 user nova-compute[76442]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 20:38:14 user nova-compute[76442]:     <timer name='hpet' present='no'/>
Nov 14 20:38:14 user nova-compute[76442]:   </clock>
Nov 14 20:38:14 user nova-compute[76442]:   <on_poweroff>destroy</on_poweroff>
Nov 14 20:38:14 user nova-compute[76442]:   <on_reboot>restart</on_reboot>
Nov 14 20:38:14 user nova-compute[76442]:   <on_crash>destroy</on_crash>
Nov 14 20:38:14 user nova-compute[76442]:   <devices>
Nov 14 20:38:14 user nova-compute[76442]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 20:38:14 user nova-compute[76442]:     <disk type='file' device='disk'>
Nov 14 20:38:14 user nova-compute[76442]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 20:38:14 user nova-compute[76442]:       <source file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk' index='2'/>
Nov 14 20:38:14 user nova-compute[76442]:       <backingStore type='file' index='3'>
Nov 14 20:38:14 user nova-compute[76442]:         <format type='raw'/>
Nov 14 20:38:14 user nova-compute[76442]:         <source file='/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6'/>
Nov 14 20:38:14 user nova-compute[76442]:         <backingStore/>
Nov 14 20:38:14 user nova-compute[76442]:       </backingStore>
Nov 14 20:38:14 user nova-compute[76442]:       <target dev='vda' bus='virtio'/>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='virtio-disk0'/>
Nov 14 20:38:14 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </disk>
Nov 14 20:38:14 user nova-compute[76442]:     <disk type='file' device='cdrom'>
Nov 14 20:38:14 user nova-compute[76442]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 20:38:14 user nova-compute[76442]:       <source file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.config' index='1'/>
Nov 14 20:38:14 user nova-compute[76442]:       <backingStore/>
Nov 14 20:38:14 user nova-compute[76442]:       <target dev='hda' bus='ide'/>
Nov 14 20:38:14 user nova-compute[76442]:       <readonly/>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='ide0-0-0'/>
Nov 14 20:38:14 user nova-compute[76442]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </disk>
Nov 14 20:38:14 user nova-compute[76442]:     <controller type='usb' index='0' model='none'>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='usb'/>
Nov 14 20:38:14 user nova-compute[76442]:     </controller>
Nov 14 20:38:14 user nova-compute[76442]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='pci.0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </controller>
Nov 14 20:38:14 user nova-compute[76442]:     <controller type='ide' index='0'>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='ide'/>
Nov 14 20:38:14 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 20:38:14 user nova-compute[76442]:     </controller>
Nov 14 20:38:14 user nova-compute[76442]:     <interface type='ethernet'>
Nov 14 20:38:14 user nova-compute[76442]:       <mac address='fa:16:3e:18:ab:0a'/>
Nov 14 20:38:14 user nova-compute[76442]:       <target dev='tap419e15ae-a9'/>
Nov 14 20:38:14 user nova-compute[76442]:       <model type='virtio'/>
Nov 14 20:38:14 user nova-compute[76442]:       <mtu size='1442'/>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='net0'/>
Nov 14 20:38:14 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </interface>
Nov 14 20:38:14 user nova-compute[76442]:     <serial type='pty'>
Nov 14 20:38:14 user nova-compute[76442]:       <source path='/dev/pts/7'/>
Nov 14 20:38:14 user nova-compute[76442]:       <log file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log' append='off'/>
Nov 14 20:38:14 user nova-compute[76442]:       <target type='isa-serial' port='0'>
Nov 14 20:38:14 user nova-compute[76442]:         <model name='isa-serial'/>
Nov 14 20:38:14 user nova-compute[76442]:       </target>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='serial0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </serial>
Nov 14 20:38:14 user nova-compute[76442]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 20:38:14 user nova-compute[76442]:       <source path='/dev/pts/7'/>
Nov 14 20:38:14 user nova-compute[76442]:       <log file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log' append='off'/>
Nov 14 20:38:14 user nova-compute[76442]:       <target type='serial' port='0'/>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='serial0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </console>
Nov 14 20:38:14 user nova-compute[76442]:     <input type='mouse' bus='ps2'>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='input0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </input>
Nov 14 20:38:14 user nova-compute[76442]:     <input type='keyboard' bus='ps2'>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='input1'/>
Nov 14 20:38:14 user nova-compute[76442]:     </input>
Nov 14 20:38:14 user nova-compute[76442]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 20:38:14 user nova-compute[76442]:       <listen type='address' address='0.0.0.0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </graphics>
Nov 14 20:38:14 user nova-compute[76442]:     <audio id='1' type='none'/>
Nov 14 20:38:14 user nova-compute[76442]:     <video>
Nov 14 20:38:14 user nova-compute[76442]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='video0'/>
Nov 14 20:38:14 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </video>
Nov 14 20:38:14 user nova-compute[76442]:     <memballoon model='virtio'>
Nov 14 20:38:14 user nova-compute[76442]:       <stats period='10'/>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='balloon0'/>
Nov 14 20:38:14 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </memballoon>
Nov 14 20:38:14 user nova-compute[76442]:     <rng model='virtio'>
Nov 14 20:38:14 user nova-compute[76442]:       <backend model='random'>/dev/urandom</backend>
Nov 14 20:38:14 user nova-compute[76442]:       <alias name='rng0'/>
Nov 14 20:38:14 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 20:38:14 user nova-compute[76442]:     </rng>
Nov 14 20:38:14 user nova-compute[76442]:   </devices>
Nov 14 20:38:14 user nova-compute[76442]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 20:38:14 user nova-compute[76442]:     <label>libvirt-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</label>
Nov 14 20:38:14 user nova-compute[76442]:     <imagelabel>libvirt-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</imagelabel>
Nov 14 20:38:14 user nova-compute[76442]:   </seclabel>
Nov 14 20:38:14 user nova-compute[76442]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 20:38:14 user nova-compute[76442]:     <label>+64055:+108</label>
Nov 14 20:38:14 user nova-compute[76442]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 20:38:14 user nova-compute[76442]:   </seclabel>
Nov 14 20:38:14 user nova-compute[76442]: </domain>
Nov 14 20:38:14 user nova-compute[76442]:  {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 20:38:14 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Successfully detached device tap2ebe3f06-09 from instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 from the live domain config.
Nov 14 20:38:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1907993261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1907993261',id=8,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhiKJDZyTPUP42ifz5q1yPR2La2BoXPkYuIiGMuPResfJc+REH8acsUVh7+sZXo4dZ9+7k9ar1BYGHmzCSWGtVHpMzaDRVfYcUEnOUl+Cf9Cuyjn9931vx9cWZ5wDkQA==',key_name='tempest-keypair-1903225505',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19f15871cfc46a797bebbc7b4bd98c8',ramdisk_id='',reservation_id='r-ozgig145',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-882538911',owner_user_name='tempest-TaggedAttachmentsTest-882538911-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5cd68ca82b403894574c8cca866c0a',uuid=d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converting VIF {"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG os_vif [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ebe3f06-09, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03929cbe-6797-416e-b0e8-0d14775b9735) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:14 user nova-compute[76442]: INFO os_vif [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09')
Nov 14 20:38:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:38:14 user nova-compute[76442]:   <nova:package version="0.0.0"/>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:name>tempest-device-tagging-server-1907993261</nova:name>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:creationTime>2023-11-14 20:38:14</nova:creationTime>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:flavor name="m1.tiny">
Nov 14 20:38:14 user nova-compute[76442]:     <nova:memory>512</nova:memory>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:disk>1</nova:disk>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:swap>0</nova:swap>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:vcpus>1</nova:vcpus>
Nov 14 20:38:14 user nova-compute[76442]:   </nova:flavor>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:owner>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:user uuid="ea5cd68ca82b403894574c8cca866c0a">tempest-TaggedAttachmentsTest-882538911-project-member</nova:user>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:project uuid="d19f15871cfc46a797bebbc7b4bd98c8">tempest-TaggedAttachmentsTest-882538911</nova:project>
Nov 14 20:38:14 user nova-compute[76442]:   </nova:owner>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:38:14 user nova-compute[76442]:   <nova:ports>
Nov 14 20:38:14 user nova-compute[76442]:     <nova:port uuid="419e15ae-a9b1-4eab-b39e-40668ff94442">
Nov 14 20:38:14 user nova-compute[76442]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:38:14 user nova-compute[76442]:     </nova:port>
Nov 14 20:38:14 user nova-compute[76442]:   </nova:ports>
Nov 14 20:38:14 user nova-compute[76442]: </nova:instance>
Nov 14 20:38:14 user nova-compute[76442]:  {{(pid=76442) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-deleted-2ebe3f06-096a-47c4-b919-cae47e172d91 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:15 user nova-compute[76442]: INFO nova.compute.manager [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Neutron deleted interface 2ebe3f06-096a-47c4-b919-cae47e172d91; detaching it from the instance and deleting it from the info cache
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updating instance_info_cache with network_info: [{"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquired lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.objects.instance [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] Lazy-loading 'system_metadata' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.objects.instance [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] Lazy-loading 'flavor' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.objects.base [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] Object Instance<d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3> lazy-loaded attributes: system_metadata,flavor {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1907993261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1907993261',id=8,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhiKJDZyTPUP42ifz5q1yPR2La2BoXPkYuIiGMuPResfJc+REH8acsUVh7+sZXo4dZ9+7k9ar1BYGHmzCSWGtVHpMzaDRVfYcUEnOUl+Cf9Cuyjn9931vx9cWZ5wDkQA==',key_name='tempest-keypair-1903225505',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19f15871cfc46a797bebbc7b4bd98c8',ramdisk_id='',reservation_id='r-ozgig145',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-882538911',owner_user_name='tempest-TaggedAttachmentsTest-882538911-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5cd68ca82b403894574c8cca866c0a',uuid=d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] Converting VIF {"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface> {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 20:38:15 user nova-compute[76442]:   <name>instance-00000008</name>
Nov 14 20:38:15 user nova-compute[76442]:   <uuid>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</uuid>
Nov 14 20:38:15 user nova-compute[76442]:   <metadata>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:38:15 user nova-compute[76442]:   <nova:package version="0.0.0"/>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:name>tempest-device-tagging-server-1907993261</nova:name>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:creationTime>2023-11-14 20:38:14</nova:creationTime>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:flavor name="m1.tiny">
Nov 14 20:38:15 user nova-compute[76442]:     <nova:memory>512</nova:memory>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:disk>1</nova:disk>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:swap>0</nova:swap>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:vcpus>1</nova:vcpus>
Nov 14 20:38:15 user nova-compute[76442]:   </nova:flavor>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:owner>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:user uuid="ea5cd68ca82b403894574c8cca866c0a">tempest-TaggedAttachmentsTest-882538911-project-member</nova:user>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:project uuid="d19f15871cfc46a797bebbc7b4bd98c8">tempest-TaggedAttachmentsTest-882538911</nova:project>
Nov 14 20:38:15 user nova-compute[76442]:   </nova:owner>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:ports>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:port uuid="419e15ae-a9b1-4eab-b39e-40668ff94442">
Nov 14 20:38:15 user nova-compute[76442]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:38:15 user nova-compute[76442]:     </nova:port>
Nov 14 20:38:15 user nova-compute[76442]:   </nova:ports>
Nov 14 20:38:15 user nova-compute[76442]: </nova:instance>
Nov 14 20:38:15 user nova-compute[76442]:   </metadata>
Nov 14 20:38:15 user nova-compute[76442]:   <memory unit='KiB'>524288</memory>
Nov 14 20:38:15 user nova-compute[76442]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 20:38:15 user nova-compute[76442]:   <vcpu placement='static'>1</vcpu>
Nov 14 20:38:15 user nova-compute[76442]:   <resource>
Nov 14 20:38:15 user nova-compute[76442]:     <partition>/machine</partition>
Nov 14 20:38:15 user nova-compute[76442]:   </resource>
Nov 14 20:38:15 user nova-compute[76442]:   <sysinfo type='smbios'>
Nov 14 20:38:15 user nova-compute[76442]:     <system>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='version'>0.0.0</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='serial'>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='uuid'>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='family'>Virtual Machine</entry>
Nov 14 20:38:15 user nova-compute[76442]:     </system>
Nov 14 20:38:15 user nova-compute[76442]:   </sysinfo>
Nov 14 20:38:15 user nova-compute[76442]:   <os>
Nov 14 20:38:15 user nova-compute[76442]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 20:38:15 user nova-compute[76442]:     <boot dev='hd'/>
Nov 14 20:38:15 user nova-compute[76442]:     <smbios mode='sysinfo'/>
Nov 14 20:38:15 user nova-compute[76442]:   </os>
Nov 14 20:38:15 user nova-compute[76442]:   <features>
Nov 14 20:38:15 user nova-compute[76442]:     <acpi/>
Nov 14 20:38:15 user nova-compute[76442]:     <apic/>
Nov 14 20:38:15 user nova-compute[76442]:     <vmcoreinfo state='on'/>
Nov 14 20:38:15 user nova-compute[76442]:   </features>
Nov 14 20:38:15 user nova-compute[76442]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 20:38:15 user nova-compute[76442]:     <model fallback='forbid'>Nehalem</model>
Nov 14 20:38:15 user nova-compute[76442]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 20:38:15 user nova-compute[76442]:     <feature policy='require' name='vme'/>
Nov 14 20:38:15 user nova-compute[76442]:     <feature policy='require' name='x2apic'/>
Nov 14 20:38:15 user nova-compute[76442]:     <feature policy='require' name='hypervisor'/>
Nov 14 20:38:15 user nova-compute[76442]:   </cpu>
Nov 14 20:38:15 user nova-compute[76442]:   <clock offset='utc'>
Nov 14 20:38:15 user nova-compute[76442]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 20:38:15 user nova-compute[76442]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 20:38:15 user nova-compute[76442]:     <timer name='hpet' present='no'/>
Nov 14 20:38:15 user nova-compute[76442]:   </clock>
Nov 14 20:38:15 user nova-compute[76442]:   <on_poweroff>destroy</on_poweroff>
Nov 14 20:38:15 user nova-compute[76442]:   <on_reboot>restart</on_reboot>
Nov 14 20:38:15 user nova-compute[76442]:   <on_crash>destroy</on_crash>
Nov 14 20:38:15 user nova-compute[76442]:   <devices>
Nov 14 20:38:15 user nova-compute[76442]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 20:38:15 user nova-compute[76442]:     <disk type='file' device='disk'>
Nov 14 20:38:15 user nova-compute[76442]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 20:38:15 user nova-compute[76442]:       <source file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk' index='2'/>
Nov 14 20:38:15 user nova-compute[76442]:       <backingStore type='file' index='3'>
Nov 14 20:38:15 user nova-compute[76442]:         <format type='raw'/>
Nov 14 20:38:15 user nova-compute[76442]:         <source file='/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6'/>
Nov 14 20:38:15 user nova-compute[76442]:         <backingStore/>
Nov 14 20:38:15 user nova-compute[76442]:       </backingStore>
Nov 14 20:38:15 user nova-compute[76442]:       <target dev='vda' bus='virtio'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='virtio-disk0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </disk>
Nov 14 20:38:15 user nova-compute[76442]:     <disk type='file' device='cdrom'>
Nov 14 20:38:15 user nova-compute[76442]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 20:38:15 user nova-compute[76442]:       <source file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.config' index='1'/>
Nov 14 20:38:15 user nova-compute[76442]:       <backingStore/>
Nov 14 20:38:15 user nova-compute[76442]:       <target dev='hda' bus='ide'/>
Nov 14 20:38:15 user nova-compute[76442]:       <readonly/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='ide0-0-0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </disk>
Nov 14 20:38:15 user nova-compute[76442]:     <controller type='usb' index='0' model='none'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='usb'/>
Nov 14 20:38:15 user nova-compute[76442]:     </controller>
Nov 14 20:38:15 user nova-compute[76442]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='pci.0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </controller>
Nov 14 20:38:15 user nova-compute[76442]:     <controller type='ide' index='0'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='ide'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 20:38:15 user nova-compute[76442]:     </controller>
Nov 14 20:38:15 user nova-compute[76442]:     <interface type='ethernet'>
Nov 14 20:38:15 user nova-compute[76442]:       <mac address='fa:16:3e:18:ab:0a'/>
Nov 14 20:38:15 user nova-compute[76442]:       <target dev='tap419e15ae-a9'/>
Nov 14 20:38:15 user nova-compute[76442]:       <model type='virtio'/>
Nov 14 20:38:15 user nova-compute[76442]:       <mtu size='1442'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='net0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </interface>
Nov 14 20:38:15 user nova-compute[76442]:     <serial type='pty'>
Nov 14 20:38:15 user nova-compute[76442]:       <source path='/dev/pts/7'/>
Nov 14 20:38:15 user nova-compute[76442]:       <log file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log' append='off'/>
Nov 14 20:38:15 user nova-compute[76442]:       <target type='isa-serial' port='0'>
Nov 14 20:38:15 user nova-compute[76442]:         <model name='isa-serial'/>
Nov 14 20:38:15 user nova-compute[76442]:       </target>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='serial0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </serial>
Nov 14 20:38:15 user nova-compute[76442]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 20:38:15 user nova-compute[76442]:       <source path='/dev/pts/7'/>
Nov 14 20:38:15 user nova-compute[76442]:       <log file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log' append='off'/>
Nov 14 20:38:15 user nova-compute[76442]:       <target type='serial' port='0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='serial0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </console>
Nov 14 20:38:15 user nova-compute[76442]:     <input type='mouse' bus='ps2'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='input0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </input>
Nov 14 20:38:15 user nova-compute[76442]:     <input type='keyboard' bus='ps2'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='input1'/>
Nov 14 20:38:15 user nova-compute[76442]:     </input>
Nov 14 20:38:15 user nova-compute[76442]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 20:38:15 user nova-compute[76442]:       <listen type='address' address='0.0.0.0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </graphics>
Nov 14 20:38:15 user nova-compute[76442]:     <audio id='1' type='none'/>
Nov 14 20:38:15 user nova-compute[76442]:     <video>
Nov 14 20:38:15 user nova-compute[76442]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='video0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </video>
Nov 14 20:38:15 user nova-compute[76442]:     <memballoon model='virtio'>
Nov 14 20:38:15 user nova-compute[76442]:       <stats period='10'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='balloon0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </memballoon>
Nov 14 20:38:15 user nova-compute[76442]:     <rng model='virtio'>
Nov 14 20:38:15 user nova-compute[76442]:       <backend model='random'>/dev/urandom</backend>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='rng0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </rng>
Nov 14 20:38:15 user nova-compute[76442]:   </devices>
Nov 14 20:38:15 user nova-compute[76442]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 20:38:15 user nova-compute[76442]:     <label>libvirt-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</label>
Nov 14 20:38:15 user nova-compute[76442]:     <imagelabel>libvirt-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</imagelabel>
Nov 14 20:38:15 user nova-compute[76442]:   </seclabel>
Nov 14 20:38:15 user nova-compute[76442]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 20:38:15 user nova-compute[76442]:     <label>+64055:+108</label>
Nov 14 20:38:15 user nova-compute[76442]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 20:38:15 user nova-compute[76442]:   </seclabel>
Nov 14 20:38:15 user nova-compute[76442]: </domain>
Nov 14 20:38:15 user nova-compute[76442]:  {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface> {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0f:d7:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ebe3f06-09"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 14 20:38:15 user nova-compute[76442]:   <name>instance-00000008</name>
Nov 14 20:38:15 user nova-compute[76442]:   <uuid>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</uuid>
Nov 14 20:38:15 user nova-compute[76442]:   <metadata>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:38:15 user nova-compute[76442]:   <nova:package version="0.0.0"/>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:name>tempest-device-tagging-server-1907993261</nova:name>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:creationTime>2023-11-14 20:38:14</nova:creationTime>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:flavor name="m1.tiny">
Nov 14 20:38:15 user nova-compute[76442]:     <nova:memory>512</nova:memory>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:disk>1</nova:disk>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:swap>0</nova:swap>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:vcpus>1</nova:vcpus>
Nov 14 20:38:15 user nova-compute[76442]:   </nova:flavor>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:owner>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:user uuid="ea5cd68ca82b403894574c8cca866c0a">tempest-TaggedAttachmentsTest-882538911-project-member</nova:user>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:project uuid="d19f15871cfc46a797bebbc7b4bd98c8">tempest-TaggedAttachmentsTest-882538911</nova:project>
Nov 14 20:38:15 user nova-compute[76442]:   </nova:owner>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:ports>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:port uuid="419e15ae-a9b1-4eab-b39e-40668ff94442">
Nov 14 20:38:15 user nova-compute[76442]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:38:15 user nova-compute[76442]:     </nova:port>
Nov 14 20:38:15 user nova-compute[76442]:   </nova:ports>
Nov 14 20:38:15 user nova-compute[76442]: </nova:instance>
Nov 14 20:38:15 user nova-compute[76442]:   </metadata>
Nov 14 20:38:15 user nova-compute[76442]:   <memory unit='KiB'>524288</memory>
Nov 14 20:38:15 user nova-compute[76442]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 20:38:15 user nova-compute[76442]:   <vcpu placement='static'>1</vcpu>
Nov 14 20:38:15 user nova-compute[76442]:   <resource>
Nov 14 20:38:15 user nova-compute[76442]:     <partition>/machine</partition>
Nov 14 20:38:15 user nova-compute[76442]:   </resource>
Nov 14 20:38:15 user nova-compute[76442]:   <sysinfo type='smbios'>
Nov 14 20:38:15 user nova-compute[76442]:     <system>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='version'>0.0.0</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='serial'>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='uuid'>d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</entry>
Nov 14 20:38:15 user nova-compute[76442]:       <entry name='family'>Virtual Machine</entry>
Nov 14 20:38:15 user nova-compute[76442]:     </system>
Nov 14 20:38:15 user nova-compute[76442]:   </sysinfo>
Nov 14 20:38:15 user nova-compute[76442]:   <os>
Nov 14 20:38:15 user nova-compute[76442]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 20:38:15 user nova-compute[76442]:     <boot dev='hd'/>
Nov 14 20:38:15 user nova-compute[76442]:     <smbios mode='sysinfo'/>
Nov 14 20:38:15 user nova-compute[76442]:   </os>
Nov 14 20:38:15 user nova-compute[76442]:   <features>
Nov 14 20:38:15 user nova-compute[76442]:     <acpi/>
Nov 14 20:38:15 user nova-compute[76442]:     <apic/>
Nov 14 20:38:15 user nova-compute[76442]:     <vmcoreinfo state='on'/>
Nov 14 20:38:15 user nova-compute[76442]:   </features>
Nov 14 20:38:15 user nova-compute[76442]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 20:38:15 user nova-compute[76442]:     <model fallback='forbid'>Nehalem</model>
Nov 14 20:38:15 user nova-compute[76442]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 20:38:15 user nova-compute[76442]:     <feature policy='require' name='vme'/>
Nov 14 20:38:15 user nova-compute[76442]:     <feature policy='require' name='x2apic'/>
Nov 14 20:38:15 user nova-compute[76442]:     <feature policy='require' name='hypervisor'/>
Nov 14 20:38:15 user nova-compute[76442]:   </cpu>
Nov 14 20:38:15 user nova-compute[76442]:   <clock offset='utc'>
Nov 14 20:38:15 user nova-compute[76442]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 20:38:15 user nova-compute[76442]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 20:38:15 user nova-compute[76442]:     <timer name='hpet' present='no'/>
Nov 14 20:38:15 user nova-compute[76442]:   </clock>
Nov 14 20:38:15 user nova-compute[76442]:   <on_poweroff>destroy</on_poweroff>
Nov 14 20:38:15 user nova-compute[76442]:   <on_reboot>restart</on_reboot>
Nov 14 20:38:15 user nova-compute[76442]:   <on_crash>destroy</on_crash>
Nov 14 20:38:15 user nova-compute[76442]:   <devices>
Nov 14 20:38:15 user nova-compute[76442]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 20:38:15 user nova-compute[76442]:     <disk type='file' device='disk'>
Nov 14 20:38:15 user nova-compute[76442]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 20:38:15 user nova-compute[76442]:       <source file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk' index='2'/>
Nov 14 20:38:15 user nova-compute[76442]:       <backingStore type='file' index='3'>
Nov 14 20:38:15 user nova-compute[76442]:         <format type='raw'/>
Nov 14 20:38:15 user nova-compute[76442]:         <source file='/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6'/>
Nov 14 20:38:15 user nova-compute[76442]:         <backingStore/>
Nov 14 20:38:15 user nova-compute[76442]:       </backingStore>
Nov 14 20:38:15 user nova-compute[76442]:       <target dev='vda' bus='virtio'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='virtio-disk0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </disk>
Nov 14 20:38:15 user nova-compute[76442]:     <disk type='file' device='cdrom'>
Nov 14 20:38:15 user nova-compute[76442]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 20:38:15 user nova-compute[76442]:       <source file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/disk.config' index='1'/>
Nov 14 20:38:15 user nova-compute[76442]:       <backingStore/>
Nov 14 20:38:15 user nova-compute[76442]:       <target dev='hda' bus='ide'/>
Nov 14 20:38:15 user nova-compute[76442]:       <readonly/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='ide0-0-0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </disk>
Nov 14 20:38:15 user nova-compute[76442]:     <controller type='usb' index='0' model='none'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='usb'/>
Nov 14 20:38:15 user nova-compute[76442]:     </controller>
Nov 14 20:38:15 user nova-compute[76442]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='pci.0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </controller>
Nov 14 20:38:15 user nova-compute[76442]:     <controller type='ide' index='0'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='ide'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 20:38:15 user nova-compute[76442]:     </controller>
Nov 14 20:38:15 user nova-compute[76442]:     <interface type='ethernet'>
Nov 14 20:38:15 user nova-compute[76442]:       <mac address='fa:16:3e:18:ab:0a'/>
Nov 14 20:38:15 user nova-compute[76442]:       <target dev='tap419e15ae-a9'/>
Nov 14 20:38:15 user nova-compute[76442]:       <model type='virtio'/>
Nov 14 20:38:15 user nova-compute[76442]:       <mtu size='1442'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='net0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </interface>
Nov 14 20:38:15 user nova-compute[76442]:     <serial type='pty'>
Nov 14 20:38:15 user nova-compute[76442]:       <source path='/dev/pts/7'/>
Nov 14 20:38:15 user nova-compute[76442]:       <log file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log' append='off'/>
Nov 14 20:38:15 user nova-compute[76442]:       <target type='isa-serial' port='0'>
Nov 14 20:38:15 user nova-compute[76442]:         <model name='isa-serial'/>
Nov 14 20:38:15 user nova-compute[76442]:       </target>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='serial0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </serial>
Nov 14 20:38:15 user nova-compute[76442]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 20:38:15 user nova-compute[76442]:       <source path='/dev/pts/7'/>
Nov 14 20:38:15 user nova-compute[76442]:       <log file='/opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3/console.log' append='off'/>
Nov 14 20:38:15 user nova-compute[76442]:       <target type='serial' port='0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='serial0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </console>
Nov 14 20:38:15 user nova-compute[76442]:     <input type='mouse' bus='ps2'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='input0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </input>
Nov 14 20:38:15 user nova-compute[76442]:     <input type='keyboard' bus='ps2'>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='input1'/>
Nov 14 20:38:15 user nova-compute[76442]:     </input>
Nov 14 20:38:15 user nova-compute[76442]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 14 20:38:15 user nova-compute[76442]:       <listen type='address' address='0.0.0.0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </graphics>
Nov 14 20:38:15 user nova-compute[76442]:     <audio id='1' type='none'/>
Nov 14 20:38:15 user nova-compute[76442]:     <video>
Nov 14 20:38:15 user nova-compute[76442]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='video0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </video>
Nov 14 20:38:15 user nova-compute[76442]:     <memballoon model='virtio'>
Nov 14 20:38:15 user nova-compute[76442]:       <stats period='10'/>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='balloon0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </memballoon>
Nov 14 20:38:15 user nova-compute[76442]:     <rng model='virtio'>
Nov 14 20:38:15 user nova-compute[76442]:       <backend model='random'>/dev/urandom</backend>
Nov 14 20:38:15 user nova-compute[76442]:       <alias name='rng0'/>
Nov 14 20:38:15 user nova-compute[76442]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 20:38:15 user nova-compute[76442]:     </rng>
Nov 14 20:38:15 user nova-compute[76442]:   </devices>
Nov 14 20:38:15 user nova-compute[76442]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 20:38:15 user nova-compute[76442]:     <label>libvirt-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</label>
Nov 14 20:38:15 user nova-compute[76442]:     <imagelabel>libvirt-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3</imagelabel>
Nov 14 20:38:15 user nova-compute[76442]:   </seclabel>
Nov 14 20:38:15 user nova-compute[76442]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 20:38:15 user nova-compute[76442]:     <label>+64055:+108</label>
Nov 14 20:38:15 user nova-compute[76442]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 20:38:15 user nova-compute[76442]:   </seclabel>
Nov 14 20:38:15 user nova-compute[76442]: </domain>
Nov 14 20:38:15 user nova-compute[76442]:  {{(pid=76442) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 20:38:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Detaching interface fa:16:3e:0f:d7:f1 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2ebe3f06-09' not found.
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1907993261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1907993261',id=8,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhiKJDZyTPUP42ifz5q1yPR2La2BoXPkYuIiGMuPResfJc+REH8acsUVh7+sZXo4dZ9+7k9ar1BYGHmzCSWGtVHpMzaDRVfYcUEnOUl+Cf9Cuyjn9931vx9cWZ5wDkQA==',key_name='tempest-keypair-1903225505',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19f15871cfc46a797bebbc7b4bd98c8',ramdisk_id='',reservation_id='r-ozgig145',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-882538911',owner_user_name='tempest-TaggedAttachmentsTest-882538911-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5cd68ca82b403894574c8cca866c0a',uuid=d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] Converting VIF {"id": "2ebe3f06-096a-47c4-b919-cae47e172d91", "address": "fa:16:3e:0f:d7:f1", "network": {"id": "a4fa93b0-a860-42dd-99fc-39c8e6e4976e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-194896133", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ebe3f06-09", "ovs_interfaceid": "2ebe3f06-096a-47c4-b919-cae47e172d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG os_vif [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ebe3f06-09, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:38:15 user nova-compute[76442]: INFO os_vif [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:d7:f1,bridge_name='br-int',has_traffic_filtering=True,id=2ebe3f06-096a-47c4-b919-cae47e172d91,network=Network(a4fa93b0-a860-42dd-99fc-39c8e6e4976e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ebe3f06-09')
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [req-e3c5485f-52f9-4400-8176-7bb3cad6f8bb req-ec4e3e46-3a87-4509-896d-aa0bb844a3e9 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:38:15 user nova-compute[76442]:   <nova:package version="0.0.0"/>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:name>tempest-device-tagging-server-1907993261</nova:name>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:creationTime>2023-11-14 20:38:15</nova:creationTime>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:flavor name="m1.tiny">
Nov 14 20:38:15 user nova-compute[76442]:     <nova:memory>512</nova:memory>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:disk>1</nova:disk>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:swap>0</nova:swap>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:vcpus>1</nova:vcpus>
Nov 14 20:38:15 user nova-compute[76442]:   </nova:flavor>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:owner>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:user uuid="ea5cd68ca82b403894574c8cca866c0a">tempest-TaggedAttachmentsTest-882538911-project-member</nova:user>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:project uuid="d19f15871cfc46a797bebbc7b4bd98c8">tempest-TaggedAttachmentsTest-882538911</nova:project>
Nov 14 20:38:15 user nova-compute[76442]:   </nova:owner>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:38:15 user nova-compute[76442]:   <nova:ports>
Nov 14 20:38:15 user nova-compute[76442]:     <nova:port uuid="419e15ae-a9b1-4eab-b39e-40668ff94442">
Nov 14 20:38:15 user nova-compute[76442]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:38:15 user nova-compute[76442]:     </nova:port>
Nov 14 20:38:15 user nova-compute[76442]:   </nova:ports>
Nov 14 20:38:15 user nova-compute[76442]: </nova:instance>
Nov 14 20:38:15 user nova-compute[76442]:  {{(pid=76442) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updating instance_info_cache with network_info: [{"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Releasing lock "refresh_cache-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b12d2892-b482-49ab-9b4f-cabdac22103d tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "interface-d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-2ebe3f06-096a-47c4-b919-cae47e172d91" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.559s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:38:15 user nova-compute[76442]: INFO nova.compute.claims [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Claim successful on node user
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:38:16 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.policy [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a9c7939d95a4ec1b47672c31de2330a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f754011c54964adcb6898beac89668e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:38:16 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Creating image(s)
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "/opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "/opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a is timed out.
Nov 14 20:38:16 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Successfully detached device vdb from instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a from the live domain config.
Nov 14 20:38:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PkujZiJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '7cee5223-982f-4854-9525-ec2947409772'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:38:16 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[21557531-f383-4650-ac36-232949c381cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:38:16 user nova-compute[76442]: No targets found.
Nov 14 20:38:16 user nova-compute[76442]: iSNS:
Nov 14 20:38:16 user nova-compute[76442]: No targets found.
Nov 14 20:38:16 user nova-compute[76442]: STATIC:
Nov 14 20:38:16 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:38:16 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:38:16 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:38:16 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772
Nov 14 20:38:16 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:38:16 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:38:16 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:38:16 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:38:16 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:38:16 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:38:16 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:38:16 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:38:16 user nova-compute[76442]: FIRMWARE:
Nov 14 20:38:16 user nova-compute[76442]: No targets found.
Nov 14 20:38:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:38:16 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:38:16 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6b9e9d-e09c-4c48-aae4-e5b1bece5bd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5c512a-9a13-40de-be3c-4579d19cbf4a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:38:16 user nova-compute[76442]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:38:16 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:16 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 (non-flash)
Nov 14 20:38:16 user nova-compute[76442]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:38:16 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:16 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e848b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772'): ({'sdg'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Removing single pathed devices sdg {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1d97c4-90ed-40f1-b506-c8b8ca8233a8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[576432bf-a17d-4306-bf32-fd25446cd325]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Flushing IO for device /dev/sdg {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d684a298-4a05-404b-a718-c202a132a8c3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b1103-8a0e-4e81-ab1e-9cb3b9fb0839]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] SCSI volumes sdg have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea3c77d-a560-4531-be35-d7f1e1f8d3a5]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08b1e1-05e2-4a95-98ad-cfbe0ec8f3a6]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260]
Nov 14 20:38:16 user nova-compute[76442]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772, portal: 172.16.0.220,3260] successful.
Nov 14 20:38:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk 1073741824" returned: 0 in 0.049s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cee5223-982f-4854-9525-ec2947409772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bafc1b-c239-44f6-af69-d3d90ed20d98]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] <== disconnect_volume: return (349ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Successfully created port: b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Cannot resize image /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Ensure instance console log exists: /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Successfully updated port: b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "refresh_cache-8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquired lock "refresh_cache-8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.objects.instance [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lazy-loading 'flavor' on Instance uuid 903f5659-0c6b-46c0-a3b1-02b8ada7154a {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-0502e10c-b333-4935-b9d8-58c7d01b127b req-37b7cc25-0520-4603-a9f4-4e6638532a9c service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received event network-changed-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-0502e10c-b333-4935-b9d8-58c7d01b127b req-37b7cc25-0520-4603-a9f4-4e6638532a9c service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Refreshing instance network info cache due to event network-changed-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0502e10c-b333-4935-b9d8-58c7d01b127b req-37b7cc25-0520-4603-a9f4-4e6638532a9c service nova] Acquiring lock "refresh_cache-8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18bc603c-9dc8-4b07-a46d-90bb11940fb2 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Updating instance_info_cache with network_info: [{"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Releasing lock "refresh_cache-8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Instance network_info: |[{"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0502e10c-b333-4935-b9d8-58c7d01b127b req-37b7cc25-0520-4603-a9f4-4e6638532a9c service nova] Acquired lock "refresh_cache-8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-0502e10c-b333-4935-b9d8-58c7d01b127b req-37b7cc25-0520-4603-a9f4-4e6638532a9c service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Refreshing network info cache for port b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Start _get_guest_xml network_info=[{"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:38:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:38:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1410097376',display_name='tempest-VolumesAdminNegativeTest-server-1410097376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1410097376',id=14,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f754011c54964adcb6898beac89668e1',ramdisk_id='',reservation_id='r-8ldc040w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1803889283',owner_user_name='tempest-VolumesAdminNegativeTest-1803889283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:38:16Z,user_data=None,user_id='6a9c7939d95a4ec1b47672c31de2330a',uuid=8ba9a4fd-19ca-49f2-b725-cec9817fc9ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converting VIF {"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=b3bc7fee-f3b9-4630-8be2-2b8d3f81e944,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc7fee-f3') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:38:18 user nova-compute[76442]:   <uuid>8ba9a4fd-19ca-49f2-b725-cec9817fc9ad</uuid>
Nov 14 20:38:18 user nova-compute[76442]:   <name>instance-0000000e</name>
Nov 14 20:38:18 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:38:18 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:38:18 user nova-compute[76442]:   <metadata>
Nov 14 20:38:18 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:38:18 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:38:18 user nova-compute[76442]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1410097376</nova:name>
Nov 14 20:38:18 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:38:18</nova:creationTime>
Nov 14 20:38:18 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:38:18 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:38:18 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:38:18 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:38:18 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:38:18 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:38:18 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:38:18 user nova-compute[76442]:       <nova:owner>
Nov 14 20:38:18 user nova-compute[76442]:         <nova:user uuid="6a9c7939d95a4ec1b47672c31de2330a">tempest-VolumesAdminNegativeTest-1803889283-project-member</nova:user>
Nov 14 20:38:18 user nova-compute[76442]:         <nova:project uuid="f754011c54964adcb6898beac89668e1">tempest-VolumesAdminNegativeTest-1803889283</nova:project>
Nov 14 20:38:18 user nova-compute[76442]:       </nova:owner>
Nov 14 20:38:18 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:38:18 user nova-compute[76442]:       <nova:ports>
Nov 14 20:38:18 user nova-compute[76442]:         <nova:port uuid="b3bc7fee-f3b9-4630-8be2-2b8d3f81e944">
Nov 14 20:38:18 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 20:38:18 user nova-compute[76442]:         </nova:port>
Nov 14 20:38:18 user nova-compute[76442]:       </nova:ports>
Nov 14 20:38:18 user nova-compute[76442]:     </nova:instance>
Nov 14 20:38:18 user nova-compute[76442]:   </metadata>
Nov 14 20:38:18 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:38:18 user nova-compute[76442]:     <system>
Nov 14 20:38:18 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:38:18 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:38:18 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:38:18 user nova-compute[76442]:       <entry name="serial">8ba9a4fd-19ca-49f2-b725-cec9817fc9ad</entry>
Nov 14 20:38:18 user nova-compute[76442]:       <entry name="uuid">8ba9a4fd-19ca-49f2-b725-cec9817fc9ad</entry>
Nov 14 20:38:18 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:38:18 user nova-compute[76442]:     </system>
Nov 14 20:38:18 user nova-compute[76442]:   </sysinfo>
Nov 14 20:38:18 user nova-compute[76442]:   <os>
Nov 14 20:38:18 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:38:18 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:38:18 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:38:18 user nova-compute[76442]:   </os>
Nov 14 20:38:18 user nova-compute[76442]:   <features>
Nov 14 20:38:18 user nova-compute[76442]:     <acpi/>
Nov 14 20:38:18 user nova-compute[76442]:     <apic/>
Nov 14 20:38:18 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:38:18 user nova-compute[76442]:   </features>
Nov 14 20:38:18 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:38:18 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:38:18 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:38:18 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:38:18 user nova-compute[76442]:   </clock>
Nov 14 20:38:18 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:38:18 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:38:18 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:38:18 user nova-compute[76442]:   </cpu>
Nov 14 20:38:18 user nova-compute[76442]:   <devices>
Nov 14 20:38:18 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:38:18 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:38:18 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk"/>
Nov 14 20:38:18 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:38:18 user nova-compute[76442]:     </disk>
Nov 14 20:38:18 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:38:18 user nova-compute[76442]:       <mac address="fa:16:3e:d5:aa:15"/>
Nov 14 20:38:18 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:38:18 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:38:18 user nova-compute[76442]:       <target dev="tapb3bc7fee-f3"/>
Nov 14 20:38:18 user nova-compute[76442]:     </interface>
Nov 14 20:38:18 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:38:18 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/console.log" append="off"/>
Nov 14 20:38:18 user nova-compute[76442]:     </serial>
Nov 14 20:38:18 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:38:18 user nova-compute[76442]:     <video>
Nov 14 20:38:18 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:38:18 user nova-compute[76442]:     </video>
Nov 14 20:38:18 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:38:18 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:38:18 user nova-compute[76442]:     </rng>
Nov 14 20:38:18 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:38:18 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:38:18 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:38:18 user nova-compute[76442]:     </memballoon>
Nov 14 20:38:18 user nova-compute[76442]:   </devices>
Nov 14 20:38:18 user nova-compute[76442]: </domain>
Nov 14 20:38:18 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1410097376',display_name='tempest-VolumesAdminNegativeTest-server-1410097376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1410097376',id=14,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f754011c54964adcb6898beac89668e1',ramdisk_id='',reservation_id='r-8ldc040w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1803889283',owner_user_name='tempest-VolumesAdminNegativeTest-1803889283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:38:16Z,user_data=None,user_id='6a9c7939d95a4ec1b47672c31de2330a',uuid=8ba9a4fd-19ca-49f2-b725-cec9817fc9ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converting VIF {"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=b3bc7fee-f3b9-4630-8be2-2b8d3f81e944,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc7fee-f3') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG os_vif [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=b3bc7fee-f3b9-4630-8be2-2b8d3f81e944,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc7fee-f3') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99c1465d-2156-55f5-808d-c548bec31fa9', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3bc7fee-f3, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3bc7fee-f3, col_values=(('qos', UUID('3eabfdc4-6a06-47a0-9b96-b0e3cab02881')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3bc7fee-f3, col_values=(('external_ids', {'iface-id': 'b3bc7fee-f3b9-4630-8be2-2b8d3f81e944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:aa:15', 'vm-uuid': '8ba9a4fd-19ca-49f2-b725-cec9817fc9ad'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:18 user nova-compute[76442]: INFO os_vif [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=b3bc7fee-f3b9-4630-8be2-2b8d3f81e944,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc7fee-f3')
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] No VIF found with MAC fa:16:3e:d5:aa:15, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-0502e10c-b333-4935-b9d8-58c7d01b127b req-37b7cc25-0520-4603-a9f4-4e6638532a9c service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Updated VIF entry in instance network info cache for port b3bc7fee-f3b9-4630-8be2-2b8d3f81e944. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-0502e10c-b333-4935-b9d8-58c7d01b127b req-37b7cc25-0520-4603-a9f4-4e6638532a9c service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Updating instance_info_cache with network_info: [{"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0502e10c-b333-4935-b9d8-58c7d01b127b req-37b7cc25-0520-4603-a9f4-4e6638532a9c service nova] Releasing lock "refresh_cache-8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-cbbc6b7c-e60e-4b65-84e5-8e29647e4630 req-e0c64cd4-91a3-4756-937d-2ed9fe3bdd32 service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received event network-vif-plugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cbbc6b7c-e60e-4b65-84e5-8e29647e4630 req-e0c64cd4-91a3-4756-937d-2ed9fe3bdd32 service nova] Acquiring lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cbbc6b7c-e60e-4b65-84e5-8e29647e4630 req-e0c64cd4-91a3-4756-937d-2ed9fe3bdd32 service nova] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cbbc6b7c-e60e-4b65-84e5-8e29647e4630 req-e0c64cd4-91a3-4756-937d-2ed9fe3bdd32 service nova] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-cbbc6b7c-e60e-4b65-84e5-8e29647e4630 req-e0c64cd4-91a3-4756-937d-2ed9fe3bdd32 service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] No waiting events found dispatching network-vif-plugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:19 user nova-compute[76442]: WARNING nova.compute.manager [req-cbbc6b7c-e60e-4b65-84e5-8e29647e4630 req-e0c64cd4-91a3-4756-937d-2ed9fe3bdd32 service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received unexpected event network-vif-plugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 for instance with vm_state building and task_state spawning.
Nov 14 20:38:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:38:21 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Instance spawned successfully.
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:21 user nova-compute[76442]: INFO nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-4096e9ab-e5cb-4073-a67f-ff24c592ff8d req-588a85d2-2b1c-4308-8b0e-19d08d992141 service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received event network-vif-plugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4096e9ab-e5cb-4073-a67f-ff24c592ff8d req-588a85d2-2b1c-4308-8b0e-19d08d992141 service nova] Acquiring lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4096e9ab-e5cb-4073-a67f-ff24c592ff8d req-588a85d2-2b1c-4308-8b0e-19d08d992141 service nova] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4096e9ab-e5cb-4073-a67f-ff24c592ff8d req-588a85d2-2b1c-4308-8b0e-19d08d992141 service nova] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-4096e9ab-e5cb-4073-a67f-ff24c592ff8d req-588a85d2-2b1c-4308-8b0e-19d08d992141 service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] No waiting events found dispatching network-vif-plugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:21 user nova-compute[76442]: WARNING nova.compute.manager [req-4096e9ab-e5cb-4073-a67f-ff24c592ff8d req-588a85d2-2b1c-4308-8b0e-19d08d992141 service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received unexpected event network-vif-plugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 for instance with vm_state building and task_state spawning.
Nov 14 20:38:21 user nova-compute[76442]: INFO nova.compute.manager [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Took 5.99 seconds to build instance.
Nov 14 20:38:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0cbef117-5006-49af-9889-a43618cdb715 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.078s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:33 user nova-compute[76442]: INFO nova.compute.manager [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Terminating instance
Nov 14 20:38:33 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:38:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-c0fcf915-8d6d-40dc-b97a-094c4769fb95 req-94013a96-0fb8-4901-a257-2be4aafed16d service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received event network-vif-unplugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c0fcf915-8d6d-40dc-b97a-094c4769fb95 req-94013a96-0fb8-4901-a257-2be4aafed16d service nova] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c0fcf915-8d6d-40dc-b97a-094c4769fb95 req-94013a96-0fb8-4901-a257-2be4aafed16d service nova] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c0fcf915-8d6d-40dc-b97a-094c4769fb95 req-94013a96-0fb8-4901-a257-2be4aafed16d service nova] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-c0fcf915-8d6d-40dc-b97a-094c4769fb95 req-94013a96-0fb8-4901-a257-2be4aafed16d service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] No waiting events found dispatching network-vif-unplugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-c0fcf915-8d6d-40dc-b97a-094c4769fb95 req-94013a96-0fb8-4901-a257-2be4aafed16d service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received event network-vif-unplugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:38:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Instance destroyed successfully.
Nov 14 20:38:34 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lazy-loading 'resources' on Instance uuid 2109949f-44c3-40d9-bed6-aef35fa5b8cd {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1744602981',display_name='tempest-VolumesAssistedSnapshotsTest-server-1744602981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1744602981',id=10,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM49O2EflI2sISbHPvkOEFj/vPbqAStnkhRUadMRgMbFhOVeSCBVfED8wmWNVW7pWUtBfo5OqmgWO2z7tOx1YDgswfXLZl1YZ+eOTptUt3yeTi42NoIMT3ofH4PAfMlSMw==',key_name='tempest-keypair-11076927',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0612cd66b9904d1298c13987fed353c8',ramdisk_id='',reservation_id='r-osie0sbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-37670104',owner_user_name='tempest-VolumesAssistedSnapshotsTest-37670104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee972d4901b142578a9c345a32023a62',uuid=2109949f-44c3-40d9-bed6-aef35fa5b8cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Converting VIF {"id": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "address": "fa:16:3e:3d:f4:bb", "network": {"id": "b1915058-fb35-456b-97ed-6bfbe56d5a53", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1488240959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0612cd66b9904d1298c13987fed353c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd83cd1ac-7b", "ovs_interfaceid": "d83cd1ac-7bcb-41ab-9a52-1102818d6189", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:f4:bb,bridge_name='br-int',has_traffic_filtering=True,id=d83cd1ac-7bcb-41ab-9a52-1102818d6189,network=Network(b1915058-fb35-456b-97ed-6bfbe56d5a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83cd1ac-7b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG os_vif [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:f4:bb,bridge_name='br-int',has_traffic_filtering=True,id=d83cd1ac-7bcb-41ab-9a52-1102818d6189,network=Network(b1915058-fb35-456b-97ed-6bfbe56d5a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83cd1ac-7b') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd83cd1ac-7b, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27564054-d45c-481f-aa8c-088a49f12223) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:34 user nova-compute[76442]: INFO os_vif [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:f4:bb,bridge_name='br-int',has_traffic_filtering=True,id=d83cd1ac-7bcb-41ab-9a52-1102818d6189,network=Network(b1915058-fb35-456b-97ed-6bfbe56d5a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd83cd1ac-7b')
Nov 14 20:38:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Deleting instance files /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd_del
Nov 14 20:38:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Deletion of /opt/stack/data/nova/instances/2109949f-44c3-40d9-bed6-aef35fa5b8cd_del complete
Nov 14 20:38:34 user nova-compute[76442]: INFO nova.compute.manager [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 20:38:34 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:38:34 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:38:35 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:35 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Took 0.62 seconds to deallocate network for instance.
Nov 14 20:38:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:35 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:38:35 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:38:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:35 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Deleted allocations for instance 2109949f-44c3-40d9-bed6-aef35fa5b8cd
Nov 14 20:38:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7f162e27-32d8-40e2-8349-0d08b4656149 tempest-VolumesAssistedSnapshotsTest-37670104 tempest-VolumesAssistedSnapshotsTest-37670104-project-member] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.054s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-f0d14cb0-de1f-48f5-8448-023992a5e310 req-1450c5bc-f495-4235-8f07-2287fe1e6fa4 service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received event network-vif-plugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f0d14cb0-de1f-48f5-8448-023992a5e310 req-1450c5bc-f495-4235-8f07-2287fe1e6fa4 service nova] Acquiring lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f0d14cb0-de1f-48f5-8448-023992a5e310 req-1450c5bc-f495-4235-8f07-2287fe1e6fa4 service nova] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f0d14cb0-de1f-48f5-8448-023992a5e310 req-1450c5bc-f495-4235-8f07-2287fe1e6fa4 service nova] Lock "2109949f-44c3-40d9-bed6-aef35fa5b8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-f0d14cb0-de1f-48f5-8448-023992a5e310 req-1450c5bc-f495-4235-8f07-2287fe1e6fa4 service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] No waiting events found dispatching network-vif-plugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:36 user nova-compute[76442]: WARNING nova.compute.manager [req-f0d14cb0-de1f-48f5-8448-023992a5e310 req-1450c5bc-f495-4235-8f07-2287fe1e6fa4 service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received unexpected event network-vif-plugged-d83cd1ac-7bcb-41ab-9a52-1102818d6189 for instance with vm_state deleted and task_state None.
Nov 14 20:38:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-f0d14cb0-de1f-48f5-8448-023992a5e310 req-1450c5bc-f495-4235-8f07-2287fe1e6fa4 service nova] [instance: 2109949f-44c3-40d9-bed6-aef35fa5b8cd] Received event network-vif-deleted-d83cd1ac-7bcb-41ab-9a52-1102818d6189 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:45 user nova-compute[76442]: INFO nova.compute.manager [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Terminating instance
Nov 14 20:38:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-c06db3ef-a2a2-418f-8ceb-cf0b5f744220 req-adc74b41-362d-4639-9cdf-6235a28c3d45 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-unplugged-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c06db3ef-a2a2-418f-8ceb-cf0b5f744220 req-adc74b41-362d-4639-9cdf-6235a28c3d45 service nova] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c06db3ef-a2a2-418f-8ceb-cf0b5f744220 req-adc74b41-362d-4639-9cdf-6235a28c3d45 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c06db3ef-a2a2-418f-8ceb-cf0b5f744220 req-adc74b41-362d-4639-9cdf-6235a28c3d45 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-c06db3ef-a2a2-418f-8ceb-cf0b5f744220 req-adc74b41-362d-4639-9cdf-6235a28c3d45 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] No waiting events found dispatching network-vif-unplugged-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-c06db3ef-a2a2-418f-8ceb-cf0b5f744220 req-adc74b41-362d-4639-9cdf-6235a28c3d45 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-unplugged-419e15ae-a9b1-4eab-b39e-40668ff94442 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:38:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Instance destroyed successfully.
Nov 14 20:38:45 user nova-compute[76442]: DEBUG nova.objects.instance [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lazy-loading 'resources' on Instance uuid d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1907993261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1907993261',id=8,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJhiKJDZyTPUP42ifz5q1yPR2La2BoXPkYuIiGMuPResfJc+REH8acsUVh7+sZXo4dZ9+7k9ar1BYGHmzCSWGtVHpMzaDRVfYcUEnOUl+Cf9Cuyjn9931vx9cWZ5wDkQA==',key_name='tempest-keypair-1903225505',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d19f15871cfc46a797bebbc7b4bd98c8',ramdisk_id='',reservation_id='r-ozgig145',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-882538911',owner_user_name='tempest-TaggedAttachmentsTest-882538911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea5cd68ca82b403894574c8cca866c0a',uuid=d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converting VIF {"id": "419e15ae-a9b1-4eab-b39e-40668ff94442", "address": "fa:16:3e:18:ab:0a", "network": {"id": "828432ac-ee58-46d4-a55d-1a89bdb3b32c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1805666647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d19f15871cfc46a797bebbc7b4bd98c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap419e15ae-a9", "ovs_interfaceid": "419e15ae-a9b1-4eab-b39e-40668ff94442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:ab:0a,bridge_name='br-int',has_traffic_filtering=True,id=419e15ae-a9b1-4eab-b39e-40668ff94442,network=Network(828432ac-ee58-46d4-a55d-1a89bdb3b32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e15ae-a9') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG os_vif [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:ab:0a,bridge_name='br-int',has_traffic_filtering=True,id=419e15ae-a9b1-4eab-b39e-40668ff94442,network=Network(828432ac-ee58-46d4-a55d-1a89bdb3b32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e15ae-a9') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap419e15ae-a9, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ec7502a-4235-43ab-a815-732cf448bb9c) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:45 user nova-compute[76442]: INFO os_vif [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:ab:0a,bridge_name='br-int',has_traffic_filtering=True,id=419e15ae-a9b1-4eab-b39e-40668ff94442,network=Network(828432ac-ee58-46d4-a55d-1a89bdb3b32c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap419e15ae-a9')
Nov 14 20:38:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Deleting instance files /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3_del
Nov 14 20:38:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Deletion of /opt/stack/data/nova/instances/d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3_del complete
Nov 14 20:38:46 user nova-compute[76442]: INFO nova.compute.manager [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 20:38:46 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:46 user nova-compute[76442]: INFO nova.compute.manager [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Terminating instance
Nov 14 20:38:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-c39bf823-568e-474a-bef8-c0b3fdb5cdaf req-315d5ea5-9bf0-4bc1-bbd3-e85d4df33a71 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received event network-vif-unplugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c39bf823-568e-474a-bef8-c0b3fdb5cdaf req-315d5ea5-9bf0-4bc1-bbd3-e85d4df33a71 service nova] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c39bf823-568e-474a-bef8-c0b3fdb5cdaf req-315d5ea5-9bf0-4bc1-bbd3-e85d4df33a71 service nova] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c39bf823-568e-474a-bef8-c0b3fdb5cdaf req-315d5ea5-9bf0-4bc1-bbd3-e85d4df33a71 service nova] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-c39bf823-568e-474a-bef8-c0b3fdb5cdaf req-315d5ea5-9bf0-4bc1-bbd3-e85d4df33a71 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] No waiting events found dispatching network-vif-unplugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-c39bf823-568e-474a-bef8-c0b3fdb5cdaf req-315d5ea5-9bf0-4bc1-bbd3-e85d4df33a71 service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received event network-vif-unplugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:38:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Instance destroyed successfully.
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lazy-loading 'resources' on Instance uuid 903f5659-0c6b-46c0-a3b1-02b8ada7154a {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-666236591',display_name='tempest-TestVolumeSwap-server-666236591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-666236591',id=9,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs9bVdnMVrDXYACqer9Ja0fERdnnt8qg04o8F/gAZv7ysP1+WyTI2gB5ASNtTPj6rTC+nDRr8tcAjCb9IEM2C+WPBUWMx/SvcwkkZUy0GT3SziHOOXSz2Tc3VhkCvjo3A==',key_name='tempest-keypair-1154491887',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f702e947c58d4ab5a957e783ca4a0f9e',ramdisk_id='',reservation_id='r-h5zqm1sv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1774718886',owner_user_name='tempest-TestVolumeSwap-1774718886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d576e790f184aeaa8824ff4b1670de9',uuid=903f5659-0c6b-46c0-a3b1-02b8ada7154a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Converting VIF {"id": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "address": "fa:16:3e:f8:3a:4e", "network": {"id": "bad41c3c-0b18-424b-80d4-b1524f48de7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-793277595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f702e947c58d4ab5a957e783ca4a0f9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cf3cee4-4d", "ovs_interfaceid": "5cf3cee4-4d55-46b3-9142-8b752b4a366b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:3a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5cf3cee4-4d55-46b3-9142-8b752b4a366b,network=Network(bad41c3c-0b18-424b-80d4-b1524f48de7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf3cee4-4d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG os_vif [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:3a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5cf3cee4-4d55-46b3-9142-8b752b4a366b,network=Network(bad41c3c-0b18-424b-80d4-b1524f48de7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf3cee4-4d') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cf3cee4-4d, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9e39f0a-f112-4277-978e-bae15e302c25) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:47 user nova-compute[76442]: INFO os_vif [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:3a:4e,bridge_name='br-int',has_traffic_filtering=True,id=5cf3cee4-4d55-46b3-9142-8b752b4a366b,network=Network(bad41c3c-0b18-424b-80d4-b1524f48de7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cf3cee4-4d')
Nov 14 20:38:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Deleting instance files /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a_del
Nov 14 20:38:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Deletion of /opt/stack/data/nova/instances/903f5659-0c6b-46c0-a3b1-02b8ada7154a_del complete
Nov 14 20:38:47 user nova-compute[76442]: INFO nova.compute.manager [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 20:38:47 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-8cb594c3-8dfe-4954-b215-0a5198f01e03 req-8ea029fe-e824-4a6e-88ea-a59e1a03e868 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-plugged-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8cb594c3-8dfe-4954-b215-0a5198f01e03 req-8ea029fe-e824-4a6e-88ea-a59e1a03e868 service nova] Acquiring lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8cb594c3-8dfe-4954-b215-0a5198f01e03 req-8ea029fe-e824-4a6e-88ea-a59e1a03e868 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8cb594c3-8dfe-4954-b215-0a5198f01e03 req-8ea029fe-e824-4a6e-88ea-a59e1a03e868 service nova] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-8cb594c3-8dfe-4954-b215-0a5198f01e03 req-8ea029fe-e824-4a6e-88ea-a59e1a03e868 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] No waiting events found dispatching network-vif-plugged-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:47 user nova-compute[76442]: WARNING nova.compute.manager [req-8cb594c3-8dfe-4954-b215-0a5198f01e03 req-8ea029fe-e824-4a6e-88ea-a59e1a03e868 service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received unexpected event network-vif-plugged-419e15ae-a9b1-4eab-b39e-40668ff94442 for instance with vm_state active and task_state deleting.
Nov 14 20:38:47 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:47 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Took 1.84 seconds to deallocate network for instance.
Nov 14 20:38:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:48 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:38:48 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:38:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:48 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Deleted allocations for instance d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3
Nov 14 20:38:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1dde19de-071f-47e1-8632-238336325819 tempest-TaggedAttachmentsTest-882538911 tempest-TaggedAttachmentsTest-882538911-project-member] Lock "d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.308s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-ccc435d6-22cc-4568-8528-fbc14ee4a6e5 req-7e2db579-38ac-4866-8186-e5fed2fdc63e service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received event network-vif-plugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ccc435d6-22cc-4568-8528-fbc14ee4a6e5 req-7e2db579-38ac-4866-8186-e5fed2fdc63e service nova] Acquiring lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ccc435d6-22cc-4568-8528-fbc14ee4a6e5 req-7e2db579-38ac-4866-8186-e5fed2fdc63e service nova] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ccc435d6-22cc-4568-8528-fbc14ee4a6e5 req-7e2db579-38ac-4866-8186-e5fed2fdc63e service nova] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-ccc435d6-22cc-4568-8528-fbc14ee4a6e5 req-7e2db579-38ac-4866-8186-e5fed2fdc63e service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] No waiting events found dispatching network-vif-plugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:49 user nova-compute[76442]: WARNING nova.compute.manager [req-ccc435d6-22cc-4568-8528-fbc14ee4a6e5 req-7e2db579-38ac-4866-8186-e5fed2fdc63e service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received unexpected event network-vif-plugged-5cf3cee4-4d55-46b3-9142-8b752b4a366b for instance with vm_state active and task_state deleting.
Nov 14 20:38:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-ccc435d6-22cc-4568-8528-fbc14ee4a6e5 req-7e2db579-38ac-4866-8186-e5fed2fdc63e service nova] [instance: d3f77d6b-26a2-4bfc-b3f3-52b023c0aad3] Received event network-vif-deleted-419e15ae-a9b1-4eab-b39e-40668ff94442 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:49 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Took 1.99 seconds to deallocate network for instance.
Nov 14 20:38:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c392684-80c9-46e0-ba3b-7a0f3941c16a req-18fdf5c5-56ce-4625-84b8-a9f3b730409f service nova] [instance: 903f5659-0c6b-46c0-a3b1-02b8ada7154a] Received event network-vif-deleted-5cf3cee4-4d55-46b3-9142-8b752b4a366b {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:38:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:49 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Deleted allocations for instance 903f5659-0c6b-46c0-a3b1-02b8ada7154a
Nov 14 20:38:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6084a97e-e62c-43d4-95d4-fd7a22278578 tempest-TestVolumeSwap-1774718886 tempest-TestVolumeSwap-1774718886-project-member] Lock "903f5659-0c6b-46c0-a3b1-02b8ada7154a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.383s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG nova.objects.instance [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'flavor' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:51 user nova-compute[76442]: INFO nova.compute.manager [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Attaching volume ff97a4a3-4c08-4e92-a262-79805755fce7 to /dev/vdb
Nov 14 20:38:51 user nova-compute[76442]: DEBUG os_brick.utils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbfa83d-b78f-49f8-b944-7952a85d2686]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5590f6be-bced-4a5c-96c8-2a7c4fc39385]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8671dc5-6a11-487f-bd99-904e80870dec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f390150-5a84-41b3-b080-cec8b4afd115]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:38:51 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:38:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca73e7-35c0-4e88-bd64-1598869efd0d]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG os_brick.utils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:38:51 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating existing volume attachment record: 5ba1692d-43d7-4523-b6e9-043688708880 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:38:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:38:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:38:52 user nova-compute[76442]: INFO nova.compute.claims [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Claim successful on node user
Nov 14 20:38:53 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG nova.network.neutron [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:38:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:38:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG nova.policy [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c34f3a6b9344181989b8f8346dabf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0103b7d8c44a4504be5a4a1a16f7623f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:38:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Creating image(s)
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "/opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "/opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk 1073741824" returned: 0 in 0.050s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Successfully created port: 07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Cannot resize image /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Ensure instance console log exists: /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Successfully updated port: 07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "refresh_cache-a7a0fef1-0074-4b13-8e19-880a1333cc95" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquired lock "refresh_cache-a7a0fef1-0074-4b13-8e19-880a1333cc95" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-1e6ba6b6-1013-4d5e-a505-8e36dd22b91a req-64e62e1e-6cc0-480a-909e-be6cdc94b022 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received event network-changed-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-1e6ba6b6-1013-4d5e-a505-8e36dd22b91a req-64e62e1e-6cc0-480a-909e-be6cdc94b022 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Refreshing instance network info cache due to event network-changed-07a30840-414e-4ca8-818c-d9e3b3d9e85e. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1e6ba6b6-1013-4d5e-a505-8e36dd22b91a req-64e62e1e-6cc0-480a-909e-be6cdc94b022 service nova] Acquiring lock "refresh_cache-a7a0fef1-0074-4b13-8e19-880a1333cc95" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:38:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.network.neutron [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Updating instance_info_cache with network_info: [{"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Releasing lock "refresh_cache-a7a0fef1-0074-4b13-8e19-880a1333cc95" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Instance network_info: |[{"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1e6ba6b6-1013-4d5e-a505-8e36dd22b91a req-64e62e1e-6cc0-480a-909e-be6cdc94b022 service nova] Acquired lock "refresh_cache-a7a0fef1-0074-4b13-8e19-880a1333cc95" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-1e6ba6b6-1013-4d5e-a505-8e36dd22b91a req-64e62e1e-6cc0-480a-909e-be6cdc94b022 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Refreshing network info cache for port 07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Start _get_guest_xml network_info=[{"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:38:55 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:38:55 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2143960022',display_name='tempest-TestServerVolumeAttachmentScenario-server-2143960022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2143960022',id=15,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq+c6KGiH5C26qPx8Fp8gDoKTGMMFh9H5mAcH4/zUz2/GE2clkDbLo4IGLk1WSwH69mLZQiOwjOBsrvAzrxB3MTEOvFEMUrkkHIg4Yp6epcZScFLAzVXU2BBhZav2SS/Q==',key_name='tempest-keypair-2039224856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0103b7d8c44a4504be5a4a1a16f7623f',ramdisk_id='',reservation_id='r-cepbfiw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-932749188',owner_user_name='tempest-TestServerVolumeAttachmentScenario-932749188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c34f3a6b9344181989b8f8346dabf8e',uuid=a7a0fef1-0074-4b13-8e19-880a1333cc95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Converting VIF {"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a3:91,bridge_name='br-int',has_traffic_filtering=True,id=07a30840-414e-4ca8-818c-d9e3b3d9e85e,network=Network(a6a46092-4fc9-4321-8d84-875744bddff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a30840-41') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.objects.instance [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lazy-loading 'pci_devices' on Instance uuid a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:38:55 user nova-compute[76442]:   <uuid>a7a0fef1-0074-4b13-8e19-880a1333cc95</uuid>
Nov 14 20:38:55 user nova-compute[76442]:   <name>instance-0000000f</name>
Nov 14 20:38:55 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:38:55 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:38:55 user nova-compute[76442]:   <metadata>
Nov 14 20:38:55 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:38:55 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:38:55 user nova-compute[76442]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2143960022</nova:name>
Nov 14 20:38:55 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:38:55</nova:creationTime>
Nov 14 20:38:55 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:38:55 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:38:55 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:38:55 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:38:55 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:38:55 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:38:55 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:38:55 user nova-compute[76442]:       <nova:owner>
Nov 14 20:38:55 user nova-compute[76442]:         <nova:user uuid="8c34f3a6b9344181989b8f8346dabf8e">tempest-TestServerVolumeAttachmentScenario-932749188-project-member</nova:user>
Nov 14 20:38:55 user nova-compute[76442]:         <nova:project uuid="0103b7d8c44a4504be5a4a1a16f7623f">tempest-TestServerVolumeAttachmentScenario-932749188</nova:project>
Nov 14 20:38:55 user nova-compute[76442]:       </nova:owner>
Nov 14 20:38:55 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:38:55 user nova-compute[76442]:       <nova:ports>
Nov 14 20:38:55 user nova-compute[76442]:         <nova:port uuid="07a30840-414e-4ca8-818c-d9e3b3d9e85e">
Nov 14 20:38:55 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:38:55 user nova-compute[76442]:         </nova:port>
Nov 14 20:38:55 user nova-compute[76442]:       </nova:ports>
Nov 14 20:38:55 user nova-compute[76442]:     </nova:instance>
Nov 14 20:38:55 user nova-compute[76442]:   </metadata>
Nov 14 20:38:55 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:38:55 user nova-compute[76442]:     <system>
Nov 14 20:38:55 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:38:55 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:38:55 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:38:55 user nova-compute[76442]:       <entry name="serial">a7a0fef1-0074-4b13-8e19-880a1333cc95</entry>
Nov 14 20:38:55 user nova-compute[76442]:       <entry name="uuid">a7a0fef1-0074-4b13-8e19-880a1333cc95</entry>
Nov 14 20:38:55 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:38:55 user nova-compute[76442]:     </system>
Nov 14 20:38:55 user nova-compute[76442]:   </sysinfo>
Nov 14 20:38:55 user nova-compute[76442]:   <os>
Nov 14 20:38:55 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:38:55 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:38:55 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:38:55 user nova-compute[76442]:   </os>
Nov 14 20:38:55 user nova-compute[76442]:   <features>
Nov 14 20:38:55 user nova-compute[76442]:     <acpi/>
Nov 14 20:38:55 user nova-compute[76442]:     <apic/>
Nov 14 20:38:55 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:38:55 user nova-compute[76442]:   </features>
Nov 14 20:38:55 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:38:55 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:38:55 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:38:55 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:38:55 user nova-compute[76442]:   </clock>
Nov 14 20:38:55 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:38:55 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:38:55 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:38:55 user nova-compute[76442]:   </cpu>
Nov 14 20:38:55 user nova-compute[76442]:   <devices>
Nov 14 20:38:55 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:38:55 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:38:55 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk"/>
Nov 14 20:38:55 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:38:55 user nova-compute[76442]:     </disk>
Nov 14 20:38:55 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:38:55 user nova-compute[76442]:       <mac address="fa:16:3e:54:a3:91"/>
Nov 14 20:38:55 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:38:55 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:38:55 user nova-compute[76442]:       <target dev="tap07a30840-41"/>
Nov 14 20:38:55 user nova-compute[76442]:     </interface>
Nov 14 20:38:55 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:38:55 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/console.log" append="off"/>
Nov 14 20:38:55 user nova-compute[76442]:     </serial>
Nov 14 20:38:55 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:38:55 user nova-compute[76442]:     <video>
Nov 14 20:38:55 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:38:55 user nova-compute[76442]:     </video>
Nov 14 20:38:55 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:38:55 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:38:55 user nova-compute[76442]:     </rng>
Nov 14 20:38:55 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:38:55 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:38:55 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:38:55 user nova-compute[76442]:     </memballoon>
Nov 14 20:38:55 user nova-compute[76442]:   </devices>
Nov 14 20:38:55 user nova-compute[76442]: </domain>
Nov 14 20:38:55 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2143960022',display_name='tempest-TestServerVolumeAttachmentScenario-server-2143960022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2143960022',id=15,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq+c6KGiH5C26qPx8Fp8gDoKTGMMFh9H5mAcH4/zUz2/GE2clkDbLo4IGLk1WSwH69mLZQiOwjOBsrvAzrxB3MTEOvFEMUrkkHIg4Yp6epcZScFLAzVXU2BBhZav2SS/Q==',key_name='tempest-keypair-2039224856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0103b7d8c44a4504be5a4a1a16f7623f',ramdisk_id='',reservation_id='r-cepbfiw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-932749188',owner_user_name='tempest-TestServerVolumeAttachmentScenario-932749188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c34f3a6b9344181989b8f8346dabf8e',uuid=a7a0fef1-0074-4b13-8e19-880a1333cc95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Converting VIF {"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a3:91,bridge_name='br-int',has_traffic_filtering=True,id=07a30840-414e-4ca8-818c-d9e3b3d9e85e,network=Network(a6a46092-4fc9-4321-8d84-875744bddff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a30840-41') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG os_vif [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a3:91,bridge_name='br-int',has_traffic_filtering=True,id=07a30840-414e-4ca8-818c-d9e3b3d9e85e,network=Network(a6a46092-4fc9-4321-8d84-875744bddff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a30840-41') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fe383e4-ace1-5062-b29c-878950bc56f3', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07a30840-41, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07a30840-41, col_values=(('qos', UUID('c346b864-f89c-42fa-a3a4-186ff1fa5d3b')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07a30840-41, col_values=(('external_ids', {'iface-id': '07a30840-414e-4ca8-818c-d9e3b3d9e85e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:a3:91', 'vm-uuid': 'a7a0fef1-0074-4b13-8e19-880a1333cc95'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:55 user nova-compute[76442]: INFO os_vif [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a3:91,bridge_name='br-int',has_traffic_filtering=True,id=07a30840-414e-4ca8-818c-d9e3b3d9e85e,network=Network(a6a46092-4fc9-4321-8d84-875744bddff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a30840-41')
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] No VIF found with MAC fa:16:3e:54:a3:91, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-1e6ba6b6-1013-4d5e-a505-8e36dd22b91a req-64e62e1e-6cc0-480a-909e-be6cdc94b022 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Updated VIF entry in instance network info cache for port 07a30840-414e-4ca8-818c-d9e3b3d9e85e. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-1e6ba6b6-1013-4d5e-a505-8e36dd22b91a req-64e62e1e-6cc0-480a-909e-be6cdc94b022 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Updating instance_info_cache with network_info: [{"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:38:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1e6ba6b6-1013-4d5e-a505-8e36dd22b91a req-64e62e1e-6cc0-480a-909e-be6cdc94b022 service nova] Releasing lock "refresh_cache-a7a0fef1-0074-4b13-8e19-880a1333cc95" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:38:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-8952143e-1cf6-4511-8e8d-2123b16a5e4c req-3b86609c-38e6-4243-b0a5-512be8753c89 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received event network-vif-plugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8952143e-1cf6-4511-8e8d-2123b16a5e4c req-3b86609c-38e6-4243-b0a5-512be8753c89 service nova] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8952143e-1cf6-4511-8e8d-2123b16a5e4c req-3b86609c-38e6-4243-b0a5-512be8753c89 service nova] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8952143e-1cf6-4511-8e8d-2123b16a5e4c req-3b86609c-38e6-4243-b0a5-512be8753c89 service nova] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-8952143e-1cf6-4511-8e8d-2123b16a5e4c req-3b86609c-38e6-4243-b0a5-512be8753c89 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] No waiting events found dispatching network-vif-plugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:57 user nova-compute[76442]: WARNING nova.compute.manager [req-8952143e-1cf6-4511-8e8d-2123b16a5e4c req-3b86609c-38e6-4243-b0a5-512be8753c89 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received unexpected event network-vif-plugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e for instance with vm_state building and task_state spawning.
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUckjItg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:38:59 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:38:59 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:38:59 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Instance spawned successfully.
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1300c573-a6f4-4a91-8525-28e0f47422a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:38:59 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac56814-54f3-4ca8-a028-6467c4629bda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7] added
Nov 14 20:38:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3681e0e-d36a-4949-88c6-0bbd82173f34]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c3a36-fdc2-4e4d-a2e9-e2cc2e10f33c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUckjItg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: INFO nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUckjItg" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c822e662-cb33-4f2a-8e2a-fea15766e549]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KUckjItg'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd82ebda-52e2-4a5c-9cb7-28b072a5c030]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f263f383-3387-4c80-ad6a-21f2b76c79be]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: INFO nova.compute.manager [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Took 6.46 seconds to build instance.
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de69f8-722c-4851-8e51-aac2167c12d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7, portal: 172.16.0.220,3260]
Nov 14 20:38:59 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7, portal: 172.16.0.220,3260] successful.
Nov 14 20:38:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40f95ee4-e487-4389-ab3f-184ca90d2ba4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.705s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aa87ff-2228-450c-8b94-41c4ba99838d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[900cc77b-a317-42f4-8dca-76b4905a9769]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:38:59 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:38:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92f5512-a894-4a66-978a-95ceea458679]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUckjItg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-46808bfb-aa1b-42f5-9767-2c8d1e896bd3 req-36a033f3-b95b-4764-a2c2-2e010ebe696e service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received event network-vif-plugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-46808bfb-aa1b-42f5-9767-2c8d1e896bd3 req-36a033f3-b95b-4764-a2c2-2e010ebe696e service nova] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-46808bfb-aa1b-42f5-9767-2c8d1e896bd3 req-36a033f3-b95b-4764-a2c2-2e010ebe696e service nova] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-46808bfb-aa1b-42f5-9767-2c8d1e896bd3 req-36a033f3-b95b-4764-a2c2-2e010ebe696e service nova] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:38:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-46808bfb-aa1b-42f5-9767-2c8d1e896bd3 req-36a033f3-b95b-4764-a2c2-2e010ebe696e service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] No waiting events found dispatching network-vif-plugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:38:59 user nova-compute[76442]: WARNING nova.compute.manager [req-46808bfb-aa1b-42f5-9767-2c8d1e896bd3 req-36a033f3-b95b-4764-a2c2-2e010ebe696e service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received unexpected event network-vif-plugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e for instance with vm_state active and task_state None.
Nov 14 20:39:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23531376361376461', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531376361376461', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:39:00 user nova-compute[76442]: DEBUG nova.objects.instance [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'flavor' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:39:00 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:39:00 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 20:39:00 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:39:00 user nova-compute[76442]:   <serial>ff97a4a3-4c08-4e92-a262-79805755fce7</serial>
Nov 14 20:39:00 user nova-compute[76442]: </disk>
Nov 14 20:39:00 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:39:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] No VIF found with MAC fa:16:3e:8d:ac:ad, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:39:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd2f9760-d398-4528-a876-47135ba2787e tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.354s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:01 user nova-compute[76442]: INFO nova.compute.manager [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Rescuing
Nov 14 20:39:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquired lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:01 user nova-compute[76442]: DEBUG nova.network.neutron [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:39:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:02 user nova-compute[76442]: DEBUG nova.network.neutron [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating instance_info_cache with network_info: [{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Releasing lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-a4eaa8bc-6f90-47ef-811f-8437419fb65a req-242c551c-1ed9-49e3-90fc-73b22d0d6a6f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-unplugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a4eaa8bc-6f90-47ef-811f-8437419fb65a req-242c551c-1ed9-49e3-90fc-73b22d0d6a6f service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a4eaa8bc-6f90-47ef-811f-8437419fb65a req-242c551c-1ed9-49e3-90fc-73b22d0d6a6f service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a4eaa8bc-6f90-47ef-811f-8437419fb65a req-242c551c-1ed9-49e3-90fc-73b22d0d6a6f service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-a4eaa8bc-6f90-47ef-811f-8437419fb65a req-242c551c-1ed9-49e3-90fc-73b22d0d6a6f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-unplugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:03 user nova-compute[76442]: WARNING nova.compute.manager [req-a4eaa8bc-6f90-47ef-811f-8437419fb65a req-242c551c-1ed9-49e3-90fc-73b22d0d6a6f service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-unplugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state active and task_state rescuing.
Nov 14 20:39:03 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquired lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG nova.network.neutron [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'info_cache' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG nova.objects.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:03 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Instance destroyed successfully.
Nov 14 20:39:03 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Attempting a stable device rescue
Nov 14 20:39:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=76442) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Instance directory exists: not creating {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 20:39:03 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Creating image(s)
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG nova.objects.instance [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "bba80c14c7e7b81a853bbb7297d257702b853c31" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "bba80c14c7e7b81a853bbb7297d257702b853c31" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e471044-9f62-4e14-9945-bed3f893c126 req-670b1f93-da49-4de6-8e6d-57b4832f36cb service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Received event network-changed-3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e471044-9f62-4e14-9945-bed3f893c126 req-670b1f93-da49-4de6-8e6d-57b4832f36cb service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Refreshing instance network info cache due to event network-changed-3182023d-98da-44fb-b40a-019fb12a70c4. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e471044-9f62-4e14-9945-bed3f893c126 req-670b1f93-da49-4de6-8e6d-57b4832f36cb service nova] Acquiring lock "refresh_cache-5f080799-d27b-4765-b4fd-5842bae26067" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e471044-9f62-4e14-9945-bed3f893c126 req-670b1f93-da49-4de6-8e6d-57b4832f36cb service nova] Acquired lock "refresh_cache-5f080799-d27b-4765-b4fd-5842bae26067" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e471044-9f62-4e14-9945-bed3f893c126 req-670b1f93-da49-4de6-8e6d-57b4832f36cb service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Refreshing network info cache for port 3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6822b85-8d2f-483a-b9a2-00211d36f8aa req-fdbfb90b-154b-4b44-8170-6e1282b3476b service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6822b85-8d2f-483a-b9a2-00211d36f8aa req-fdbfb90b-154b-4b44-8170-6e1282b3476b service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6822b85-8d2f-483a-b9a2-00211d36f8aa req-fdbfb90b-154b-4b44-8170-6e1282b3476b service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6822b85-8d2f-483a-b9a2-00211d36f8aa req-fdbfb90b-154b-4b44-8170-6e1282b3476b service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6822b85-8d2f-483a-b9a2-00211d36f8aa req-fdbfb90b-154b-4b44-8170-6e1282b3476b service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:05 user nova-compute[76442]: WARNING nova.compute.manager [req-c6822b85-8d2f-483a-b9a2-00211d36f8aa req-fdbfb90b-154b-4b44-8170-6e1282b3476b service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state active and task_state rescuing.
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "5f080799-d27b-4765-b4fd-5842bae26067" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "5f080799-d27b-4765-b4fd-5842bae26067" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "5f080799-d27b-4765-b4fd-5842bae26067-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "5f080799-d27b-4765-b4fd-5842bae26067-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "5f080799-d27b-4765-b4fd-5842bae26067-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:05 user nova-compute[76442]: INFO nova.compute.manager [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Terminating instance
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31.part --force-share --output=json" returned: 0 in 0.213s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.virt.images [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] 0e29f92b-8214-4f99-84e9-4444cf75508e was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31.part /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating instance_info_cache with network_info: [{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Releasing lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:39:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance destroyed successfully.
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'resources' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31.part /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31.converted" returned: 0 in 0.455s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878133652',display_name='tempest-AttachVolumeTestJSON-server-878133652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878133652',id=4,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDheVhyXKd1tLetq6drOD0c1HXCNMGuyk4trFFV+OHU/w0jSDxWd/s0s9dAgCq1IdTQzrf7GK4Rv/3WoY7/OLU1yzzvADVAojoOIUFiIYeEUqj31jXAcxcBX+C/r+XI6AQ==',key_name='tempest-keypair-857353389',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-nein8fe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=d7c90b52-307d-4a1d-98ab-68449f84c3f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_vif [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefe55142-46, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20435293-293f-4925-9dba-a1209f6555e1) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: INFO os_vif [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46')
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLcysEmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:06 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daadc86-b7cd-4f7c-aaf1-b23ab3bba182]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:39:06 user nova-compute[76442]: No targets found.
Nov 14 20:39:06 user nova-compute[76442]: iSNS:
Nov 14 20:39:06 user nova-compute[76442]: No targets found.
Nov 14 20:39:06 user nova-compute[76442]: STATIC:
Nov 14 20:39:06 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:39:06 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:39:06 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:39:06 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:39:06 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:39:06 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:39:06 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:39:06 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:39:06 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:39:06 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:39:06 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:39:06 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:39:06 user nova-compute[76442]: FIRMWARE:
Nov 14 20:39:06 user nova-compute[76442]: No targets found.
Nov 14 20:39:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:39:06 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:39:06 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "bba80c14c7e7b81a853bbb7297d257702b853c31" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.604s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6a7960-b273-48f8-bf41-fdbe2daacc62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "bba80c14c7e7b81a853bbb7297d257702b853c31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "bba80c14c7e7b81a853bbb7297d257702b853c31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[751b8031-fa60-4725-a243-e6fd332cd2c2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4e2d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64'): ({'sdf'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Removing single pathed devices sdf {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b880ab-fa37-47f6-b64a-ca7962eae4ec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Instance destroyed successfully.
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'resources' on Instance uuid 5f080799-d27b-4765-b4fd-5842bae26067 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5585e117-61f8-4e24-98cc-b01e536e031c]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flushing IO for device /dev/sdf {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1941064526',display_name='tempest-AttachVolumeNegativeTest-server-1941064526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1941064526',id=12,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOQ3HAY8ZP14gmoQ0tILXsq50z6fx1vNoA+EvkSx29Y6VnnCMRaPaL0l9FBTJZDSwsfKH5Mf5XtU3po3sUmwpJ6FlnbmjeQF5ANniBviFfw72ufE0+q8GJkw4EkboOaGw==',key_name='tempest-keypair-1092319666',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:37:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-l2z3d8dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=5f080799-d27b-4765-b4fd-5842bae26067,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=3182023d-98da-44fb-b40a-019fb12a70c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3182023d-98') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_vif [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=3182023d-98da-44fb-b40a-019fb12a70c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3182023d-98') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3182023d-98, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d485693-0271-49d7-aeef-72fb10558245]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3246cd4a-17b6-4047-b644-6731fddadfe7) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e471044-9f62-4e14-9945-bed3f893c126 req-670b1f93-da49-4de6-8e6d-57b4832f36cb service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Updated VIF entry in instance network info cache for port 3182023d-98da-44fb-b40a-019fb12a70c4. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.network.neutron [req-4e471044-9f62-4e14-9945-bed3f893c126 req-670b1f93-da49-4de6-8e6d-57b4832f36cb service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Updating instance_info_cache with network_info: [{"id": "3182023d-98da-44fb-b40a-019fb12a70c4", "address": "fa:16:3e:c2:e4:7a", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3182023d-98", "ovs_interfaceid": "3182023d-98da-44fb-b40a-019fb12a70c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:06 user nova-compute[76442]: INFO os_vif [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:7a,bridge_name='br-int',has_traffic_filtering=True,id=3182023d-98da-44fb-b40a-019fb12a70c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3182023d-98')
Nov 14 20:39:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Deleting instance files /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067_del
Nov 14 20:39:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Deletion of /opt/stack/data/nova/instances/5f080799-d27b-4765-b4fd-5842bae26067_del complete
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e471044-9f62-4e14-9945-bed3f893c126 req-670b1f93-da49-4de6-8e6d-57b4832f36cb service nova] Releasing lock "refresh_cache-5f080799-d27b-4765-b4fd-5842bae26067" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1f9188-bfe4-4b3e-8177-547bdc050d36]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31 --force-share --output=json" returned: 0 in 0.201s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31,backing_fmt=raw /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7d1a02-4a35-4b4d-b6ff-f97ab63a714a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31,backing_fmt=raw /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue" returned: 0 in 0.051s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "bba80c14c7e7b81a853bbb7297d257702b853c31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'migration_context' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:06 user nova-compute[76442]: INFO nova.compute.manager [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Object Instance<3f966f64-95e9-4de8-8464-a7ed018b8db6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Start _get_guest_xml network_info=[{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "vif_mac": "fa:16:3e:8d:ac:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0e29f92b-8214-4f99-84e9-4444cf75508e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUckjItg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3f966f64-95e9-4de8-8464-a7ed018b8db6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff97a4a3-4c08-4e92-a262-79805755fce7', 'serial': 'ff97a4a3-4c08-4e92-a262-79805755fce7'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'attachment_id': '5ba1692d-43d7-4523-b6e9-043688708880', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'resources' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Object Instance<3f966f64-95e9-4de8-8464-a7ed018b8db6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3ba8c3-1d15-4a63-af04-c12f43aa87f3]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260]
Nov 14 20:39:06 user nova-compute[76442]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260] successful.
Nov 14 20:39:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Object Instance<3f966f64-95e9-4de8-8464-a7ed018b8db6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cccd3c5-df41-4626-ae06-0d52979f4686]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== disconnect_volume: return (404ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Start _get_guest_xml network_info=[{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLcysEmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd7c90b52-307d-4a1d-98ab-68449f84c3f2', 'attached_at': '', 'detached_at': '', 'volume_id': '94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 'serial': '94bbbc8a-4c4c-4876-bca5-19a6e3f07d64'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'attachment_id': '6585ad3a-5040-4e7e-9245-3a99f64b818d', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'numa_topology' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Object Instance<3f966f64-95e9-4de8-8464-a7ed018b8db6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUckjItg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:06 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:06 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:06 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fd83f4-dde8-4598-8297-f6a9271d3980]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KUckjItg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 20:39:06 user nova-compute[76442]: node.name = iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:39:06 user nova-compute[76442]: node.tpgt = -1
Nov 14 20:39:06 user nova-compute[76442]: node.startup = automatic
Nov 14 20:39:06 user nova-compute[76442]: node.leading_login = No
Nov 14 20:39:06 user nova-compute[76442]: iface.iscsi_ifacename = default
Nov 14 20:39:06 user nova-compute[76442]: iface.net_ifacename = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.ipaddress = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.prefix_len = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.hwaddress = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.transport_name = tcp
Nov 14 20:39:06 user nova-compute[76442]: iface.initiatorname = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.state = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.vlan_id = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.vlan_priority = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.vlan_state = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.iface_num = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.mtu = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.port = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.bootproto = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.subnet_mask = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.gateway = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.dhcp_alt_client_id = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.dhcp_dns = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.dhcp_learn_iqn = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.dhcp_vendor_id_state = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.dhcp_vendor_id = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.dhcp_slp_da = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.fragmentation = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.gratuitous_arp = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.incoming_forwarding = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.tos_state = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.tos = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.ttl = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.delayed_ack = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.tcp_nagle = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.tcp_wsf_state = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.tcp_wsf = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.tcp_timer_scale = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.tcp_timestamp = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.redirect = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.def_task_mgmt_timeout = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.header_digest = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.data_digest = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.immediate_data = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.initial_r2t = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.data_seq_inorder = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.data_pdu_inorder = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.erl = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.max_receive_data_len = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.first_burst_len = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.max_outstanding_r2t = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.max_burst_len = 0
Nov 14 20:39:06 user nova-compute[76442]: iface.chap_auth = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.bidi_chap = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.strict_login_compliance = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.discovery_auth = <empty>
Nov 14 20:39:06 user nova-compute[76442]: iface.discovery_logout = <empty>
Nov 14 20:39:06 user nova-compute[76442]: node.discovery_address = <empty>
Nov 14 20:39:06 user nova-compute[76442]: node.discovery_port = 0
Nov 14 20:39:06 user nova-compute[76442]: node.discovery_type = static
Nov 14 20:39:06 user nova-compute[76442]: node.session.initial_cmdsn = 0
Nov 14 20:39:06 user nova-compute[76442]: node.session.initial_login_retry_max = 8
Nov 14 20:39:06 user nova-compute[76442]: node.session.xmit_thread_priority = -20
Nov 14 20:39:06 user nova-compute[76442]: node.session.cmds_max = 128
Nov 14 20:39:06 user nova-compute[76442]: node.session.queue_depth = 32
Nov 14 20:39:06 user nova-compute[76442]: node.session.nr_sessions = 1
Nov 14 20:39:06 user nova-compute[76442]: node.session.auth.authmethod = CHAP
Nov 14 20:39:06 user nova-compute[76442]: node.session.auth.username = KUckjItg
Nov 14 20:39:06 user nova-compute[76442]: node.session.auth.password = ***
Nov 14 20:39:06 user nova-compute[76442]: node.session.auth.username_in = <empty>
Nov 14 20:39:06 user nova-compute[76442]: node.session.auth.password_in = <empty>
Nov 14 20:39:06 user nova-compute[76442]: node.session.auth.chap_algs = MD5
Nov 14 20:39:06 user nova-compute[76442]: node.session.timeo.replacement_timeout = 120
Nov 14 20:39:06 user nova-compute[76442]: node.session.err_timeo.abort_timeout = 15
Nov 14 20:39:06 user nova-compute[76442]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 20:39:06 user nova-compute[76442]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 20:39:06 user nova-compute[76442]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.FastAbort = Yes
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.InitialR2T = No
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.ImmediateData = Yes
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.MaxConnections = 1
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 20:39:06 user nova-compute[76442]: node.session.iscsi.ERL = 0
Nov 14 20:39:06 user nova-compute[76442]: node.session.scan = manual
Nov 14 20:39:06 user nova-compute[76442]: node.session.reopen_max = 0
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].address = 172.16.0.220
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].port = 3260
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].startup = manual
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].tcp.window_size = 524288
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].tcp.type_of_service = 0
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].timeo.logout_timeout = 15
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].timeo.login_timeout = 15
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].timeo.auth_timeout = 45
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].iscsi.DataDigest = None
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].iscsi.IFMarker = No
Nov 14 20:39:06 user nova-compute[76442]: node.conn[0].iscsi.OFMarker = No
Nov 14 20:39:06 user nova-compute[76442]: # END RECORD
Nov 14 20:39:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.objects.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLcysEmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:06 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb2821-b2d4-4660-af1d-b4bcb7b9c766]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5330e896-71a6-4902-bb2b-41f42b76461e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUckjItg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUckjItg" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4faf3e-ce02-4ecb-9b47-467478a06da0]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KUckjItg'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9829d7ad-ec81-4e97-a420-d49a1a75fc01]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating instance_info_cache with network_info: [{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[19826b40-e69e-45c0-a17c-be5225b50fe5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:06 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.011s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[99506b5c-039b-421d-bb62-bda5b836ec60]: (4, ('0 0 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUckjItg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '23531376361376461', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531376361376461', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.124s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:06 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:06 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f06ede-5980-4424-b1f1-d5d4d1ba52cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:39:06 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[140ba138-53c2-42ac-9f61-1a48a50b46bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64] added
Nov 14 20:39:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.124s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ede5927-04a2-4d0e-9470-402d1beeef22]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fa736c-3213-4058-82d0-ef0106180e2a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLcysEmV {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLcysEmV" returned: 0 in 0.042s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceaab80-6772-4ad9-836b-654dc6a6410f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BLcysEmV'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-335839947',display_name='tempest-ServerStableDeviceRescueTest-server-335839947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-335839947',id=5,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/XqWsEw0A7lQIR+/+6ZeguQtqwARyySz2E7GtGl2FNgl2f+Q/zJQXKVM2Al5vTWFFKeACaFh/bkGhYeTapvX8ssprXr8Ndv/dc89RmirS6tmlKpy+FydEjDL+sf6jb7w==',key_name='tempest-keypair-1389631806',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec1263fe84fb4684a1a09ca104614513',ramdisk_id='',reservation_id='r-69vsu0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1286396350',owner_user_name='tempest-ServerStableDeviceRescueTest-1286396350-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:37:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1af6b467fdcf4757ada855e3d83d11d2',uuid=3f966f64-95e9-4de8-8464-a7ed018b8db6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "vif_mac": "fa:16:3e:8d:ac:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Converting VIF {"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "vif_mac": "fa:16:3e:8d:ac:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ac:ad,bridge_name='br-int',has_traffic_filtering=True,id=c58581ff-741a-45f7-a75f-11a6a5ee71ce,network=Network(dec26ce6-a4d7-44f8-802a-476a75ece865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58581ff-74') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.objects.instance [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.objects.base [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Object Instance<3f966f64-95e9-4de8-8464-a7ed018b8db6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:39:07 user nova-compute[76442]:   <uuid>3f966f64-95e9-4de8-8464-a7ed018b8db6</uuid>
Nov 14 20:39:07 user nova-compute[76442]:   <name>instance-00000005</name>
Nov 14 20:39:07 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:39:07 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:39:07 user nova-compute[76442]:   <metadata>
Nov 14 20:39:07 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:39:07 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:39:07 user nova-compute[76442]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-335839947</nova:name>
Nov 14 20:39:07 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:39:06</nova:creationTime>
Nov 14 20:39:07 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:39:07 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:39:07 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:39:07 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:39:07 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:39:07 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:39:07 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:39:07 user nova-compute[76442]:       <nova:owner>
Nov 14 20:39:07 user nova-compute[76442]:         <nova:user uuid="1af6b467fdcf4757ada855e3d83d11d2">tempest-ServerStableDeviceRescueTest-1286396350-project-member</nova:user>
Nov 14 20:39:07 user nova-compute[76442]:         <nova:project uuid="ec1263fe84fb4684a1a09ca104614513">tempest-ServerStableDeviceRescueTest-1286396350</nova:project>
Nov 14 20:39:07 user nova-compute[76442]:       </nova:owner>
Nov 14 20:39:07 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:39:07 user nova-compute[76442]:       <nova:ports>
Nov 14 20:39:07 user nova-compute[76442]:         <nova:port uuid="c58581ff-741a-45f7-a75f-11a6a5ee71ce">
Nov 14 20:39:07 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 20:39:07 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:07 user nova-compute[76442]:       </nova:ports>
Nov 14 20:39:07 user nova-compute[76442]:     </nova:instance>
Nov 14 20:39:07 user nova-compute[76442]:   </metadata>
Nov 14 20:39:07 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:39:07 user nova-compute[76442]:     <system>
Nov 14 20:39:07 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:39:07 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:39:07 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:39:07 user nova-compute[76442]:       <entry name="serial">3f966f64-95e9-4de8-8464-a7ed018b8db6</entry>
Nov 14 20:39:07 user nova-compute[76442]:       <entry name="uuid">3f966f64-95e9-4de8-8464-a7ed018b8db6</entry>
Nov 14 20:39:07 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:39:07 user nova-compute[76442]:     </system>
Nov 14 20:39:07 user nova-compute[76442]:   </sysinfo>
Nov 14 20:39:07 user nova-compute[76442]:   <os>
Nov 14 20:39:07 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:39:07 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:39:07 user nova-compute[76442]:   </os>
Nov 14 20:39:07 user nova-compute[76442]:   <features>
Nov 14 20:39:07 user nova-compute[76442]:     <acpi/>
Nov 14 20:39:07 user nova-compute[76442]:     <apic/>
Nov 14 20:39:07 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:39:07 user nova-compute[76442]:   </features>
Nov 14 20:39:07 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:39:07 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:39:07 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:39:07 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:39:07 user nova-compute[76442]:   </clock>
Nov 14 20:39:07 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:39:07 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:39:07 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:39:07 user nova-compute[76442]:   </cpu>
Nov 14 20:39:07 user nova-compute[76442]:   <devices>
Nov 14 20:39:07 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:39:07 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:39:07 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk"/>
Nov 14 20:39:07 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:39:07 user nova-compute[76442]:     </disk>
Nov 14 20:39:07 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:39:07 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:39:07 user nova-compute[76442]:       <source dev="/dev/sdc"/>
Nov 14 20:39:07 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:39:07 user nova-compute[76442]:       <serial>ff97a4a3-4c08-4e92-a262-79805755fce7</serial>
Nov 14 20:39:07 user nova-compute[76442]:     </disk>
Nov 14 20:39:07 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:39:07 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:39:07 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue"/>
Nov 14 20:39:07 user nova-compute[76442]:       <target dev="vdc" bus="virtio"/>
Nov 14 20:39:07 user nova-compute[76442]:       <boot order="1"/>
Nov 14 20:39:07 user nova-compute[76442]:     </disk>
Nov 14 20:39:07 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:07 user nova-compute[76442]:       <mac address="fa:16:3e:8d:ac:ad"/>
Nov 14 20:39:07 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:07 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:07 user nova-compute[76442]:       <target dev="tapc58581ff-74"/>
Nov 14 20:39:07 user nova-compute[76442]:     </interface>
Nov 14 20:39:07 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:39:07 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/console.log" append="off"/>
Nov 14 20:39:07 user nova-compute[76442]:     </serial>
Nov 14 20:39:07 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:39:07 user nova-compute[76442]:     <video>
Nov 14 20:39:07 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:07 user nova-compute[76442]:     </video>
Nov 14 20:39:07 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:39:07 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:39:07 user nova-compute[76442]:     </rng>
Nov 14 20:39:07 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:39:07 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:39:07 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:39:07 user nova-compute[76442]:     </memballoon>
Nov 14 20:39:07 user nova-compute[76442]:   </devices>
Nov 14 20:39:07 user nova-compute[76442]: </domain>
Nov 14 20:39:07 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc88b9d-b94f-475b-87fc-c64a45a939fe]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Instance destroyed successfully.
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.116s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[93833235-994a-41a8-9829-dfd1036533cc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a98c76-92ae-4cab-9b92-95a241e218e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260]
Nov 14 20:39:07 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260] successful.
Nov 14 20:39:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] No VIF found with MAC fa:16:3e:8d:ac:ad, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1398cdcd-f0c0-40d6-b2cc-93e19c73e291]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00b23de-e2f7-4260-8f1e-db15eaf8d09e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:07 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.768s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:39:07 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Took 1.08 seconds to deallocate network for instance.
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-8cdd7688-8e49-4d56-94c6-818858092fa2 req-a1d0205b-edbd-4340-b036-8debc0420614 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Received event network-vif-deleted-3182023d-98da-44fb-b40a-019fb12a70c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:07 user nova-compute[76442]: INFO nova.compute.manager [req-8cdd7688-8e49-4d56-94c6-818858092fa2 req-a1d0205b-edbd-4340-b036-8debc0420614 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Neutron deleted interface 3182023d-98da-44fb-b40a-019fb12a70c4; detaching it from the instance and deleting it from the info cache
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.network.neutron [req-8cdd7688-8e49-4d56-94c6-818858092fa2 req-a1d0205b-edbd-4340-b036-8debc0420614 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0a6701-9135-4aab-86b6-df85061e5c00]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLcysEmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-8cdd7688-8e49-4d56-94c6-818858092fa2 req-a1d0205b-edbd-4340-b036-8debc0420614 service nova] [instance: 5f080799-d27b-4765-b4fd-5842bae26067] Detach interface failed, port_id=3182023d-98da-44fb-b40a-019fb12a70c4, reason: Instance 5f080799-d27b-4765-b4fd-5842bae26067 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:08 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Deleted allocations for instance 5f080799-d27b-4765-b4fd-5842bae26067
Nov 14 20:39:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c61a355-300d-4cd1-b90c-fcaf45c290ca tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "5f080799-d27b-4765-b4fd-5842bae26067" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.975s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.809s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== connect_volume: return (1937ms) {'type': 'block', 'scsi_wwn': '26163386262383435', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163386262383435', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878133652',display_name='tempest-AttachVolumeTestJSON-server-878133652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878133652',id=4,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDheVhyXKd1tLetq6drOD0c1HXCNMGuyk4trFFV+OHU/w0jSDxWd/s0s9dAgCq1IdTQzrf7GK4Rv/3WoY7/OLU1yzzvADVAojoOIUFiIYeEUqj31jXAcxcBX+C/r+XI6AQ==',key_name='tempest-keypair-857353389',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-nein8fe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=d7c90b52-307d-4a1d-98ab-68449f84c3f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'pci_devices' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.objects.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:39:08 user nova-compute[76442]:   <uuid>d7c90b52-307d-4a1d-98ab-68449f84c3f2</uuid>
Nov 14 20:39:08 user nova-compute[76442]:   <name>instance-00000004</name>
Nov 14 20:39:08 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:39:08 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:39:08 user nova-compute[76442]:   <metadata>
Nov 14 20:39:08 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:39:08 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:39:08 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeTestJSON-server-878133652</nova:name>
Nov 14 20:39:08 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:39:06</nova:creationTime>
Nov 14 20:39:08 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:39:08 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:39:08 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:39:08 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:39:08 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:39:08 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:39:08 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:39:08 user nova-compute[76442]:       <nova:owner>
Nov 14 20:39:08 user nova-compute[76442]:         <nova:user uuid="1451459113e244e798fff66799c10c48">tempest-AttachVolumeTestJSON-650801364-project-member</nova:user>
Nov 14 20:39:08 user nova-compute[76442]:         <nova:project uuid="b1e7d9ec7d5342a797576c7e568c1073">tempest-AttachVolumeTestJSON-650801364</nova:project>
Nov 14 20:39:08 user nova-compute[76442]:       </nova:owner>
Nov 14 20:39:08 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:39:08 user nova-compute[76442]:       <nova:ports>
Nov 14 20:39:08 user nova-compute[76442]:         <nova:port uuid="efe55142-461c-40ce-a422-d396af94b09d">
Nov 14 20:39:08 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 20:39:08 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:08 user nova-compute[76442]:       </nova:ports>
Nov 14 20:39:08 user nova-compute[76442]:     </nova:instance>
Nov 14 20:39:08 user nova-compute[76442]:   </metadata>
Nov 14 20:39:08 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:39:08 user nova-compute[76442]:     <system>
Nov 14 20:39:08 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:39:08 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:39:08 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:39:08 user nova-compute[76442]:       <entry name="serial">d7c90b52-307d-4a1d-98ab-68449f84c3f2</entry>
Nov 14 20:39:08 user nova-compute[76442]:       <entry name="uuid">d7c90b52-307d-4a1d-98ab-68449f84c3f2</entry>
Nov 14 20:39:08 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:39:08 user nova-compute[76442]:     </system>
Nov 14 20:39:08 user nova-compute[76442]:   </sysinfo>
Nov 14 20:39:08 user nova-compute[76442]:   <os>
Nov 14 20:39:08 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:39:08 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:39:08 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:39:08 user nova-compute[76442]:   </os>
Nov 14 20:39:08 user nova-compute[76442]:   <features>
Nov 14 20:39:08 user nova-compute[76442]:     <acpi/>
Nov 14 20:39:08 user nova-compute[76442]:     <apic/>
Nov 14 20:39:08 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:39:08 user nova-compute[76442]:   </features>
Nov 14 20:39:08 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:39:08 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:39:08 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:39:08 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:39:08 user nova-compute[76442]:   </clock>
Nov 14 20:39:08 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:39:08 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:39:08 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:39:08 user nova-compute[76442]:   </cpu>
Nov 14 20:39:08 user nova-compute[76442]:   <devices>
Nov 14 20:39:08 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:39:08 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:39:08 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk"/>
Nov 14 20:39:08 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:39:08 user nova-compute[76442]:     </disk>
Nov 14 20:39:08 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:39:08 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:39:08 user nova-compute[76442]:       <source dev="/dev/sdd"/>
Nov 14 20:39:08 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:39:08 user nova-compute[76442]:       <serial>94bbbc8a-4c4c-4876-bca5-19a6e3f07d64</serial>
Nov 14 20:39:08 user nova-compute[76442]:     </disk>
Nov 14 20:39:08 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:08 user nova-compute[76442]:       <mac address="fa:16:3e:d2:0d:f0"/>
Nov 14 20:39:08 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:08 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:08 user nova-compute[76442]:       <target dev="tapefe55142-46"/>
Nov 14 20:39:08 user nova-compute[76442]:     </interface>
Nov 14 20:39:08 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:39:08 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/console.log" append="off"/>
Nov 14 20:39:08 user nova-compute[76442]:     </serial>
Nov 14 20:39:08 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:39:08 user nova-compute[76442]:     <video>
Nov 14 20:39:08 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:08 user nova-compute[76442]:     </video>
Nov 14 20:39:08 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:39:08 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:39:08 user nova-compute[76442]:     </rng>
Nov 14 20:39:08 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:39:08 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:39:08 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:39:08 user nova-compute[76442]:     </memballoon>
Nov 14 20:39:08 user nova-compute[76442]:   </devices>
Nov 14 20:39:08 user nova-compute[76442]: </domain>
Nov 14 20:39:08 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'trusted_certs' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.objects.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Cannot resize image /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'migration_context' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.objects.base [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878133652',display_name='tempest-AttachVolumeTestJSON-server-878133652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878133652',id=4,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDheVhyXKd1tLetq6drOD0c1HXCNMGuyk4trFFV+OHU/w0jSDxWd/s0s9dAgCq1IdTQzrf7GK4Rv/3WoY7/OLU1yzzvADVAojoOIUFiIYeEUqj31jXAcxcBX+C/r+XI6AQ==',key_name='tempest-keypair-857353389',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-nein8fe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=d7c90b52-307d-4a1d-98ab-68449f84c3f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG os_vif [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41af6940-7304-5c25-9ae4-97b019a2a897', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:09 user nova-compute[76442]: WARNING nova.compute.manager [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state active and task_state rescuing.
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:09 user nova-compute[76442]: WARNING nova.compute.manager [req-94eb1599-98c4-44da-a2b1-2b04817ab2e5 req-778baa43-a919-4c46-8f34-dc42b22b0a1e service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state active and task_state rescuing.
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefe55142-46, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefe55142-46, col_values=(('qos', UUID('ae38436f-af13-4def-8045-f3ac8dd2fc5a')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefe55142-46, col_values=(('external_ids', {'iface-id': 'efe55142-461c-40ce-a422-d396af94b09d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:0d:f0', 'vm-uuid': 'd7c90b52-307d-4a1d-98ab-68449f84c3f2'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:09 user nova-compute[76442]: INFO os_vif [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46')
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-d88f59e6-124a-4ca1-97ec-624c6af0551d req-aa2b8a72-c8d5-4b9e-b59b-6f75bbc814f1 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d88f59e6-124a-4ca1-97ec-624c6af0551d req-aa2b8a72-c8d5-4b9e-b59b-6f75bbc814f1 service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d88f59e6-124a-4ca1-97ec-624c6af0551d req-aa2b8a72-c8d5-4b9e-b59b-6f75bbc814f1 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d88f59e6-124a-4ca1-97ec-624c6af0551d req-aa2b8a72-c8d5-4b9e-b59b-6f75bbc814f1 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-d88f59e6-124a-4ca1-97ec-624c6af0551d req-aa2b8a72-c8d5-4b9e-b59b-6f75bbc814f1 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:13 user nova-compute[76442]: WARNING nova.compute.manager [req-d88f59e6-124a-4ca1-97ec-624c6af0551d req-aa2b8a72-c8d5-4b9e-b59b-6f75bbc814f1 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state stopped and task_state powering-on.
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-b76b7d04-4440-47e6-bd92-1a5e6f896eca req-5c15944d-31c6-43ef-bf49-1320efb80dea service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b76b7d04-4440-47e6-bd92-1a5e6f896eca req-5c15944d-31c6-43ef-bf49-1320efb80dea service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b76b7d04-4440-47e6-bd92-1a5e6f896eca req-5c15944d-31c6-43ef-bf49-1320efb80dea service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b76b7d04-4440-47e6-bd92-1a5e6f896eca req-5c15944d-31c6-43ef-bf49-1320efb80dea service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-b76b7d04-4440-47e6-bd92-1a5e6f896eca req-5c15944d-31c6-43ef-bf49-1320efb80dea service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:13 user nova-compute[76442]: WARNING nova.compute.manager [req-b76b7d04-4440-47e6-bd92-1a5e6f896eca req-5c15944d-31c6-43ef-bf49-1320efb80dea service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state stopped and task_state powering-on.
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-798b9ed8-7dde-4dd8-9e82-e4835e273842 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:39:13 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:13 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8323MB free_disk=25.399303436279297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance rebooted successfully.
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7ffaf0ff-a144-41eb-a5a0-b3e9406f5c45 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance da018992-79f4-4db3-bbf7-a492508ff629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a7a0fef1-0074-4b13-8e19-880a1333cc95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:39:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:39:14 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:39:14 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:39:14 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:39:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "31c7399a-07f6-40d7-a62c-8fa374193ba0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:39:24 user nova-compute[76442]: INFO nova.compute.claims [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Claim successful on node user
Nov 14 20:39:24 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:24 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:39:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:39:24 user nova-compute[76442]: DEBUG nova.policy [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26d34d0a5ada4aaf84176788da8c781c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05a3b23802440898218c51c6f6eb0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:39:25 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Creating image(s)
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "/opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "/opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "/opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:39:25 user nova-compute[76442]: INFO nova.compute.claims [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Claim successful on node user
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.229s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.217s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk 1073741824" returned: 0 in 0.064s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.208s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.754s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Cannot resize image /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Ensure instance console log exists: /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:39:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:39:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Successfully created port: ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:39:26 user nova-compute[76442]: INFO nova.virt.block_device [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Booting with volume ffd9b893-a2d4-4b22-b7d7-857f130c05fc at /dev/vda
Nov 14 20:39:26 user nova-compute[76442]: DEBUG nova.policy [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d6015fa259d4659afce1794a9e3de38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e62fa5383e4a83aff08bfd6ac92f1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG os_brick.utils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6595bdf3-118c-4266-aac4-94f76bdb6c13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7757d519-dff9-4e2f-b93d-e7c983a8bd17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc5e569-f560-412f-9eeb-b7184dff1dd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d396be85-3b9e-434b-acd0-035086861233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:39:26 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:39:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb45fda-962b-4f17-8cf7-4463626f3ba3]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG os_brick.utils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:26 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating existing volume attachment record: eda2fefe-8c55-4c75-9b0b-5303592a32fd {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Successfully updated port: ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "refresh_cache-31c7399a-07f6-40d7-a62c-8fa374193ba0" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquired lock "refresh_cache-31c7399a-07f6-40d7-a62c-8fa374193ba0" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-6b930cbf-58c2-40e0-8d23-bb07ca3528c4 req-1a52e7dd-6aa9-4132-adaf-e327688142fc service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received event network-changed-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-6b930cbf-58c2-40e0-8d23-bb07ca3528c4 req-1a52e7dd-6aa9-4132-adaf-e327688142fc service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Refreshing instance network info cache due to event network-changed-ad6892f7-b246-4e5d-84db-bde7463fad35. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6b930cbf-58c2-40e0-8d23-bb07ca3528c4 req-1a52e7dd-6aa9-4132-adaf-e327688142fc service nova] Acquiring lock "refresh_cache-31c7399a-07f6-40d7-a62c-8fa374193ba0" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully created port: 2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Updating instance_info_cache with network_info: [{"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Releasing lock "refresh_cache-31c7399a-07f6-40d7-a62c-8fa374193ba0" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Instance network_info: |[{"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6b930cbf-58c2-40e0-8d23-bb07ca3528c4 req-1a52e7dd-6aa9-4132-adaf-e327688142fc service nova] Acquired lock "refresh_cache-31c7399a-07f6-40d7-a62c-8fa374193ba0" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.neutron [req-6b930cbf-58c2-40e0-8d23-bb07ca3528c4 req-1a52e7dd-6aa9-4132-adaf-e327688142fc service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Refreshing network info cache for port ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Start _get_guest_xml network_info=[{"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:39:27 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:27 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1128440010',display_name='tempest-ServersNegativeTestJSON-server-1128440010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1128440010',id=16,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d05a3b23802440898218c51c6f6eb0cf',ramdisk_id='',reservation_id='r-qqnktgnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-145042559',owner_user_name='tempest-ServersNegativeTestJSON-145042559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:25Z,user_data=None,user_id='26d34d0a5ada4aaf84176788da8c781c',uuid=31c7399a-07f6-40d7-a62c-8fa374193ba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converting VIF {"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:13:e2,bridge_name='br-int',has_traffic_filtering=True,id=ad6892f7-b246-4e5d-84db-bde7463fad35,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6892f7-b2') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.objects.instance [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lazy-loading 'pci_devices' on Instance uuid 31c7399a-07f6-40d7-a62c-8fa374193ba0 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:39:27 user nova-compute[76442]:   <uuid>31c7399a-07f6-40d7-a62c-8fa374193ba0</uuid>
Nov 14 20:39:27 user nova-compute[76442]:   <name>instance-00000010</name>
Nov 14 20:39:27 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:39:27 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:39:27 user nova-compute[76442]:   <metadata>
Nov 14 20:39:27 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:39:27 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:39:27 user nova-compute[76442]:       <nova:name>tempest-ServersNegativeTestJSON-server-1128440010</nova:name>
Nov 14 20:39:27 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:39:27</nova:creationTime>
Nov 14 20:39:27 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:39:27 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:39:27 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:39:27 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:39:27 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:39:27 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:39:27 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:39:27 user nova-compute[76442]:       <nova:owner>
Nov 14 20:39:27 user nova-compute[76442]:         <nova:user uuid="26d34d0a5ada4aaf84176788da8c781c">tempest-ServersNegativeTestJSON-145042559-project-member</nova:user>
Nov 14 20:39:27 user nova-compute[76442]:         <nova:project uuid="d05a3b23802440898218c51c6f6eb0cf">tempest-ServersNegativeTestJSON-145042559</nova:project>
Nov 14 20:39:27 user nova-compute[76442]:       </nova:owner>
Nov 14 20:39:27 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:39:27 user nova-compute[76442]:       <nova:ports>
Nov 14 20:39:27 user nova-compute[76442]:         <nova:port uuid="ad6892f7-b246-4e5d-84db-bde7463fad35">
Nov 14 20:39:27 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:39:27 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:27 user nova-compute[76442]:       </nova:ports>
Nov 14 20:39:27 user nova-compute[76442]:     </nova:instance>
Nov 14 20:39:27 user nova-compute[76442]:   </metadata>
Nov 14 20:39:27 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:39:27 user nova-compute[76442]:     <system>
Nov 14 20:39:27 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:39:27 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:39:27 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:39:27 user nova-compute[76442]:       <entry name="serial">31c7399a-07f6-40d7-a62c-8fa374193ba0</entry>
Nov 14 20:39:27 user nova-compute[76442]:       <entry name="uuid">31c7399a-07f6-40d7-a62c-8fa374193ba0</entry>
Nov 14 20:39:27 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:39:27 user nova-compute[76442]:     </system>
Nov 14 20:39:27 user nova-compute[76442]:   </sysinfo>
Nov 14 20:39:27 user nova-compute[76442]:   <os>
Nov 14 20:39:27 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:39:27 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:39:27 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:39:27 user nova-compute[76442]:   </os>
Nov 14 20:39:27 user nova-compute[76442]:   <features>
Nov 14 20:39:27 user nova-compute[76442]:     <acpi/>
Nov 14 20:39:27 user nova-compute[76442]:     <apic/>
Nov 14 20:39:27 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:39:27 user nova-compute[76442]:   </features>
Nov 14 20:39:27 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:39:27 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:39:27 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:39:27 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:39:27 user nova-compute[76442]:   </clock>
Nov 14 20:39:27 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:39:27 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:39:27 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:39:27 user nova-compute[76442]:   </cpu>
Nov 14 20:39:27 user nova-compute[76442]:   <devices>
Nov 14 20:39:27 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:39:27 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:39:27 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk"/>
Nov 14 20:39:27 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:39:27 user nova-compute[76442]:     </disk>
Nov 14 20:39:27 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:27 user nova-compute[76442]:       <mac address="fa:16:3e:58:13:e2"/>
Nov 14 20:39:27 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:27 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:27 user nova-compute[76442]:       <target dev="tapad6892f7-b2"/>
Nov 14 20:39:27 user nova-compute[76442]:     </interface>
Nov 14 20:39:27 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:39:27 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/console.log" append="off"/>
Nov 14 20:39:27 user nova-compute[76442]:     </serial>
Nov 14 20:39:27 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:39:27 user nova-compute[76442]:     <video>
Nov 14 20:39:27 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:27 user nova-compute[76442]:     </video>
Nov 14 20:39:27 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:39:27 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:39:27 user nova-compute[76442]:     </rng>
Nov 14 20:39:27 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:39:27 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:39:27 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:39:27 user nova-compute[76442]:     </memballoon>
Nov 14 20:39:27 user nova-compute[76442]:   </devices>
Nov 14 20:39:27 user nova-compute[76442]: </domain>
Nov 14 20:39:27 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1128440010',display_name='tempest-ServersNegativeTestJSON-server-1128440010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1128440010',id=16,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d05a3b23802440898218c51c6f6eb0cf',ramdisk_id='',reservation_id='r-qqnktgnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-145042559',owner_user_name='tempest-ServersNegativeTestJSON-145042559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:25Z,user_data=None,user_id='26d34d0a5ada4aaf84176788da8c781c',uuid=31c7399a-07f6-40d7-a62c-8fa374193ba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converting VIF {"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:13:e2,bridge_name='br-int',has_traffic_filtering=True,id=ad6892f7-b246-4e5d-84db-bde7463fad35,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6892f7-b2') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG os_vif [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:13:e2,bridge_name='br-int',has_traffic_filtering=True,id=ad6892f7-b246-4e5d-84db-bde7463fad35,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6892f7-b2') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8d37385-a11f-51e3-ba05-7e327b67ffa8', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad6892f7-b2, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad6892f7-b2, col_values=(('qos', UUID('dee3ba50-a5f4-4512-b2ee-1331a674e2d4')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad6892f7-b2, col_values=(('external_ids', {'iface-id': 'ad6892f7-b246-4e5d-84db-bde7463fad35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:13:e2', 'vm-uuid': '31c7399a-07f6-40d7-a62c-8fa374193ba0'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:27 user nova-compute[76442]: INFO os_vif [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:13:e2,bridge_name='br-int',has_traffic_filtering=True,id=ad6892f7-b246-4e5d-84db-bde7463fad35,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6892f7-b2')
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] No VIF found with MAC fa:16:3e:58:13:e2, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:39:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully created port: c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:39:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-6b930cbf-58c2-40e0-8d23-bb07ca3528c4 req-1a52e7dd-6aa9-4132-adaf-e327688142fc service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Updated VIF entry in instance network info cache for port ad6892f7-b246-4e5d-84db-bde7463fad35. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:39:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-6b930cbf-58c2-40e0-8d23-bb07ca3528c4 req-1a52e7dd-6aa9-4132-adaf-e327688142fc service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Updating instance_info_cache with network_info: [{"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6b930cbf-58c2-40e0-8d23-bb07ca3528c4 req-1a52e7dd-6aa9-4132-adaf-e327688142fc service nova] Releasing lock "refresh_cache-31c7399a-07f6-40d7-a62c-8fa374193ba0" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:28 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully created port: 450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully created port: 93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-d3643da6-2661-4cd6-8a6b-073a87fd2ee6 req-a7d45593-3904-4066-ae7b-b5561c1b7fdf service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received event network-vif-plugged-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d3643da6-2661-4cd6-8a6b-073a87fd2ee6 req-a7d45593-3904-4066-ae7b-b5561c1b7fdf service nova] Acquiring lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d3643da6-2661-4cd6-8a6b-073a87fd2ee6 req-a7d45593-3904-4066-ae7b-b5561c1b7fdf service nova] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d3643da6-2661-4cd6-8a6b-073a87fd2ee6 req-a7d45593-3904-4066-ae7b-b5561c1b7fdf service nova] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-d3643da6-2661-4cd6-8a6b-073a87fd2ee6 req-a7d45593-3904-4066-ae7b-b5561c1b7fdf service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] No waiting events found dispatching network-vif-plugged-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:29 user nova-compute[76442]: WARNING nova.compute.manager [req-d3643da6-2661-4cd6-8a6b-073a87fd2ee6 req-a7d45593-3904-4066-ae7b-b5561c1b7fdf service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received unexpected event network-vif-plugged-ad6892f7-b246-4e5d-84db-bde7463fad35 for instance with vm_state building and task_state spawning.
Nov 14 20:39:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:30 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully created port: ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully updated port: 2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-3da098cf-e7f2-4344-bd73-c33df390716e req-ae54d987-3357-4662-8cba-889e5596f894 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-changed-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-3da098cf-e7f2-4344-bd73-c33df390716e req-ae54d987-3357-4662-8cba-889e5596f894 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing instance network info cache due to event network-changed-2e91aa0a-5a60-4adc-9ec7-50814a3918fd. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3da098cf-e7f2-4344-bd73-c33df390716e req-ae54d987-3357-4662-8cba-889e5596f894 service nova] Acquiring lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3da098cf-e7f2-4344-bd73-c33df390716e req-ae54d987-3357-4662-8cba-889e5596f894 service nova] Acquired lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-3da098cf-e7f2-4344-bd73-c33df390716e req-ae54d987-3357-4662-8cba-889e5596f894 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing network info cache for port 2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-3da098cf-e7f2-4344-bd73-c33df390716e req-ae54d987-3357-4662-8cba-889e5596f894 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:39:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Instance spawned successfully.
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-3da098cf-e7f2-4344-bd73-c33df390716e req-ae54d987-3357-4662-8cba-889e5596f894 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3da098cf-e7f2-4344-bd73-c33df390716e req-ae54d987-3357-4662-8cba-889e5596f894 service nova] Releasing lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:31 user nova-compute[76442]: INFO nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-c3556d65-6d40-49c8-993e-1b5920a25eb3 req-37774b61-04dd-4fbb-834e-61e22f3d81ba service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received event network-vif-plugged-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c3556d65-6d40-49c8-993e-1b5920a25eb3 req-37774b61-04dd-4fbb-834e-61e22f3d81ba service nova] Acquiring lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c3556d65-6d40-49c8-993e-1b5920a25eb3 req-37774b61-04dd-4fbb-834e-61e22f3d81ba service nova] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c3556d65-6d40-49c8-993e-1b5920a25eb3 req-37774b61-04dd-4fbb-834e-61e22f3d81ba service nova] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-c3556d65-6d40-49c8-993e-1b5920a25eb3 req-37774b61-04dd-4fbb-834e-61e22f3d81ba service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] No waiting events found dispatching network-vif-plugged-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:31 user nova-compute[76442]: WARNING nova.compute.manager [req-c3556d65-6d40-49c8-993e-1b5920a25eb3 req-37774b61-04dd-4fbb-834e-61e22f3d81ba service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received unexpected event network-vif-plugged-ad6892f7-b246-4e5d-84db-bde7463fad35 for instance with vm_state building and task_state spawning.
Nov 14 20:39:31 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully updated port: 8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:31 user nova-compute[76442]: INFO nova.compute.manager [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Took 7.74 seconds to build instance.
Nov 14 20:39:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4c8b6634-2f72-4506-829d-9a0754805e9c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.847s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:32 user nova-compute[76442]: INFO nova.virt.block_device [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Booting with volume ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 at /dev/vdb
Nov 14 20:39:32 user nova-compute[76442]: DEBUG os_brick.utils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d756a52-ec39-4d0f-88fe-2bb0bf043372]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[862af927-4883-4d04-8448-dc916cc1996e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0592a46e-dc9a-433d-939f-b2f442ae965e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6652e1-ef67-42e5-9171-e081b7a4e128]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:39:32 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:39:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[31593125-bf3e-463d-883d-98de11c13713]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG os_brick.utils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating existing volume attachment record: 66a7f56f-5395-432e-95e5-b4ea40557710 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully updated port: 8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully updated port: c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-changed-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing instance network info cache due to event network-changed-8fb1678c-0972-4bbe-98a4-67677ac6e2d2. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] Acquiring lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] Acquired lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.network.neutron [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing network info cache for port 8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.network.neutron [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.network.neutron [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] Releasing lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-changed-8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing instance network info cache due to event network-changed-8c570d93-b917-4c24-a002-876b00044b1c. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] Acquiring lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] Acquired lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.network.neutron [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing network info cache for port 8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.network.neutron [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.network.neutron [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dfd85534-954d-438d-a222-1f66f9aee4bc req-2a8e3aa3-6617-4661-ac08-ca351a99edfe service nova] Releasing lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:33 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully updated port: 450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully updated port: 93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-changed-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing instance network info cache due to event network-changed-c1f45401-6091-40a4-b051-84ebfd71b966. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] Acquiring lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] Acquired lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing network info cache for port c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] Releasing lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-changed-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing instance network info cache due to event network-changed-450fa94f-63d9-46f5-a4e8-69af6585df23. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] Acquiring lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] Acquired lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing network info cache for port 450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Successfully updated port: ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG nova.network.neutron [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] Releasing lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-changed-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing instance network info cache due to event network-changed-93a5bd0e-57a0-4a08-811c-dc9a12a06e54. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] Acquiring lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] Acquired lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG nova.network.neutron [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing network info cache for port 93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG nova.network.neutron [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG nova.network.neutron [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9eeca6c8-0452-436c-8c2e-dd97c6b342a7 req-50d37c87-d7e4-4e35-b636-60891aae939d service nova] Releasing lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquired lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:39:36 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-8da283ce-fe4f-4d67-8527-8892105228bc req-b110ac56-44fe-419a-9f9a-7d162cc09b58 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-changed-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-8da283ce-fe4f-4d67-8527-8892105228bc req-b110ac56-44fe-419a-9f9a-7d162cc09b58 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing instance network info cache due to event network-changed-ec963ded-b534-4f97-b8df-4257671d2fe9. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8da283ce-fe4f-4d67-8527-8892105228bc req-b110ac56-44fe-419a-9f9a-7d162cc09b58 service nova] Acquiring lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:37 user nova-compute[76442]: INFO nova.virt.block_device [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Booting with volume 692a6d7e-d181-4b0b-9f67-019aab85ef35 at /dev/vdc
Nov 14 20:39:37 user nova-compute[76442]: DEBUG os_brick.utils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[154e2951-c1e0-4c82-ac8e-1f69e9645bd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f2da0-a4c0-468d-ba6b-be18e92e7042]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[459d1cfa-52e0-4226-987e-02225c786efd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b81e54-d901-4add-98cc-8ce564ae7baa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:39:38 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fb816f-7793-4ba2-ad5a-af1f8ab8c28e]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG os_brick.utils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating existing volume attachment record: 88d87dcc-5422-452d-a451-6e6eff6ef747 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [{"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Releasing lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance network_info: |[{"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8da283ce-fe4f-4d67-8527-8892105228bc req-b110ac56-44fe-419a-9f9a-7d162cc09b58 service nova] Acquired lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:38 user nova-compute[76442]: DEBUG nova.network.neutron [req-8da283ce-fe4f-4d67-8527-8892105228bc req-b110ac56-44fe-419a-9f9a-7d162cc09b58 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing network info cache for port ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:39 user nova-compute[76442]: DEBUG nova.network.neutron [req-8da283ce-fe4f-4d67-8527-8892105228bc req-b110ac56-44fe-419a-9f9a-7d162cc09b58 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updated VIF entry in instance network info cache for port ec963ded-b534-4f97-b8df-4257671d2fe9. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:39:39 user nova-compute[76442]: DEBUG nova.network.neutron [req-8da283ce-fe4f-4d67-8527-8892105228bc req-b110ac56-44fe-419a-9f9a-7d162cc09b58 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [{"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8da283ce-fe4f-4d67-8527-8892105228bc req-b110ac56-44fe-419a-9f9a-7d162cc09b58 service nova] Releasing lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:42 user nova-compute[76442]: INFO nova.compute.manager [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Rescuing
Nov 14 20:39:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquired lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:42 user nova-compute[76442]: DEBUG nova.network.neutron [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:39:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.network.neutron [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updating instance_info_cache with network_info: [{"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:39:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Creating image(s)
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Ensure instance console log exists: /opt/stack/data/nova/instances/af2fc78b-7d41-4aed-88a2-ebf2952a0af7/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Start _get_guest_xml network_info=[{"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwuBTFCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffd9b893-a2d4-4b22-b7d7-857f130c05fc', 'serial': 'ffd9b893-a2d4-4b22-b7d7-857f130c05fc'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'eda2fefe-8c55-4c75-9b0b-5303592a32fd', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLRyuoQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69', 'serial': 'ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69'}, 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'attachment_id': '66a7f56f-5395-432e-95e5-b4ea40557710', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYzBlZkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7', 'attached_at': '', 'detached_at': '', 'volume_id': '692a6d7e-d181-4b0b-9f67-019aab85ef35', 'serial': '692a6d7e-d181-4b0b-9f67-019aab85ef35'}, 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'attachment_id': '88d87dcc-5422-452d-a451-6e6eff6ef747', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Releasing lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:43 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:43 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwuBTFCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:43 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:43 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:43 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae17fe8-f51e-405e-82a3-20581ac522ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:39:43 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75cee29-57be-4c24-a8ca-1bdb6c1af5c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc] added
Nov 14 20:39:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55ac12e-1326-44e4-bc76-403bb48e1b63]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[da666c21-c476-489b-b129-8283343caa7c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwuBTFCx {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwuBTFCx" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d42fe6-f74e-4ba4-9267-cd9b6503732e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SwuBTFCx'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e59112-60d0-4ddb-aa5f-c8648081bf8b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e15c40-24a0-42bc-89ca-2e00d2e47da3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7b72f0-7527-44b3-843e-39a17c65391a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc, portal: 172.16.0.220,3260]
Nov 14 20:39:43 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc, portal: 172.16.0.220,3260] successful.
Nov 14 20:39:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55cc85a-790c-4d56-a9d1-7b152e6bbd02]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67c6497-c95c-4258-8018-d54d8d3678d4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:43 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:39:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0e911c-8001-47bf-b2b7-308082ae7910]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwuBTFCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Instance destroyed successfully.
Nov 14 20:39:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Attempting a stable device rescue
Nov 14 20:39:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76442) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Instance directory exists: not creating {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 20:39:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Creating image(s)
Nov 14 20:39:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "/opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "/opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "/opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG nova.objects.instance [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "ce107f827be52b960e0c9efb1a4200695b018bd8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "ce107f827be52b960e0c9efb1a4200695b018bd8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.305s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] <== connect_volume: return (2308ms) {'type': 'block', 'scsi_wwn': '23437386632376533', 'path': '/dev/sdf'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437386632376533', 'path': '/dev/sdf'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-ed6ca850-ee8c-41bb-b51f-c33f544c7173 req-67af65cd-57e3-486e-9bb7-a9778f5c93f6 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-unplugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ed6ca850-ee8c-41bb-b51f-c33f544c7173 req-67af65cd-57e3-486e-9bb7-a9778f5c93f6 service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ed6ca850-ee8c-41bb-b51f-c33f544c7173 req-67af65cd-57e3-486e-9bb7-a9778f5c93f6 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ed6ca850-ee8c-41bb-b51f-c33f544c7173 req-67af65cd-57e3-486e-9bb7-a9778f5c93f6 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-ed6ca850-ee8c-41bb-b51f-c33f544c7173 req-67af65cd-57e3-486e-9bb7-a9778f5c93f6 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-unplugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:45 user nova-compute[76442]: WARNING nova.compute.manager [req-ed6ca850-ee8c-41bb-b51f-c33f544c7173 req-67af65cd-57e3-486e-9bb7-a9778f5c93f6 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-unplugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state active and task_state rescuing.
Nov 14 20:39:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLRyuoQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:45 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:45 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:45 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:39:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b83d63-4a22-4507-b053-c75db741ecb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:39:46 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae9bfc-6541-48fd-8bf6-0325c2c775c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69] added
Nov 14 20:39:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8.part --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG nova.virt.images [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] 57c3d25e-643f-4e62-80b9-54786f4cf3f8 was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8.part /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcb50ad-485a-4b98-b65c-b95294704c8b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e5bfc5-08af-4b32-87e7-0dc3ee3fb003]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLRyuoQI {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLRyuoQI" returned: 0 in 0.155s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[106761cd-0685-43b9-a6b9-fb803c249ffc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OLRyuoQI'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.125s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8c28be-1095-4f4c-8854-95fa83396ff0]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f919c6-37fc-4850-832c-cc732ec3ada9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d8dda4-4397-48d6-8d47-607c04b63858]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69, portal: 172.16.0.220,3260]
Nov 14 20:39:46 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69, portal: 172.16.0.220,3260] successful.
Nov 14 20:39:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.057s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46671c7-6563-403d-a1cc-59affa808644]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[10981671-37c1-4871-9b42-2032d51a9fc5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:39:46 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.720s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9dfdfe-e422-4801-8816-865ea87a72dd]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8.part /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8.converted" returned: 0 in 0.762s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8.converted --force-share --output=json" returned: 0 in 0.244s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "ce107f827be52b960e0c9efb1a4200695b018bd8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.480s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "ce107f827be52b960e0c9efb1a4200695b018bd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "ce107f827be52b960e0c9efb1a4200695b018bd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8 --force-share --output=json" returned: 0 in 0.207s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8,backing_fmt=raw /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8,backing_fmt=raw /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue" returned: 0 in 0.051s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "ce107f827be52b960e0c9efb1a4200695b018bd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'migration_context' on Instance uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.objects.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<5253f642-7c49-4c03-8d13-5105497b4f5d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Start _get_guest_xml network_info=[{"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "vif_mac": "fa:16:3e:fa:28:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '57c3d25e-643f-4e62-80b9-54786f4cf3f8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLFkYdUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5253f642-7c49-4c03-8d13-5105497b4f5d', 'attached_at': '', 'detached_at': '', 'volume_id': '2f1e11e0-aaef-47a6-ac09-77d6960195d6', 'serial': '2f1e11e0-aaef-47a6-ac09-77d6960195d6'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '1d34691d-1e44-4f59-a6ad-94c2b82f08db', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'resources' on Instance uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.objects.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<5253f642-7c49-4c03-8d13-5105497b4f5d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'numa_topology' on Instance uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.objects.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<5253f642-7c49-4c03-8d13-5105497b4f5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:47 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:47 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.objects.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<5253f642-7c49-4c03-8d13-5105497b4f5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLFkYdUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:47 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLRyuoQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.845s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] <== connect_volume: return (1846ms) {'type': 'block', 'scsi_wwn': '23033656361343561', 'path': '/dev/sdg'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033656361343561', 'path': '/dev/sdg'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.317s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:47 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:47 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:39:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[62349913-271d-4ea2-bcd8-abe81802031f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qLFkYdUM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 20:39:47 user nova-compute[76442]: node.name = iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:39:47 user nova-compute[76442]: node.tpgt = -1
Nov 14 20:39:47 user nova-compute[76442]: node.startup = automatic
Nov 14 20:39:47 user nova-compute[76442]: node.leading_login = No
Nov 14 20:39:47 user nova-compute[76442]: iface.iscsi_ifacename = default
Nov 14 20:39:47 user nova-compute[76442]: iface.net_ifacename = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.ipaddress = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.prefix_len = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.hwaddress = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.transport_name = tcp
Nov 14 20:39:47 user nova-compute[76442]: iface.initiatorname = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.state = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.vlan_id = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.vlan_priority = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.vlan_state = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.iface_num = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.mtu = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.port = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.bootproto = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.subnet_mask = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.gateway = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.dhcp_alt_client_id = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.dhcp_dns = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.dhcp_learn_iqn = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.dhcp_vendor_id_state = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.dhcp_vendor_id = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.dhcp_slp_da = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.fragmentation = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.gratuitous_arp = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.incoming_forwarding = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.tos_state = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.tos = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.ttl = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.delayed_ack = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.tcp_nagle = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.tcp_wsf_state = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.tcp_wsf = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.tcp_timer_scale = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.tcp_timestamp = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.redirect = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.def_task_mgmt_timeout = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.header_digest = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.data_digest = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.immediate_data = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.initial_r2t = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.data_seq_inorder = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.data_pdu_inorder = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.erl = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.max_receive_data_len = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.first_burst_len = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.max_outstanding_r2t = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.max_burst_len = 0
Nov 14 20:39:47 user nova-compute[76442]: iface.chap_auth = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.bidi_chap = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.strict_login_compliance = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.discovery_auth = <empty>
Nov 14 20:39:47 user nova-compute[76442]: iface.discovery_logout = <empty>
Nov 14 20:39:47 user nova-compute[76442]: node.discovery_address = <empty>
Nov 14 20:39:47 user nova-compute[76442]: node.discovery_port = 0
Nov 14 20:39:47 user nova-compute[76442]: node.discovery_type = static
Nov 14 20:39:47 user nova-compute[76442]: node.session.initial_cmdsn = 0
Nov 14 20:39:47 user nova-compute[76442]: node.session.initial_login_retry_max = 8
Nov 14 20:39:47 user nova-compute[76442]: node.session.xmit_thread_priority = -20
Nov 14 20:39:47 user nova-compute[76442]: node.session.cmds_max = 128
Nov 14 20:39:47 user nova-compute[76442]: node.session.queue_depth = 32
Nov 14 20:39:47 user nova-compute[76442]: node.session.nr_sessions = 1
Nov 14 20:39:47 user nova-compute[76442]: node.session.auth.authmethod = CHAP
Nov 14 20:39:47 user nova-compute[76442]: node.session.auth.username = qLFkYdUM
Nov 14 20:39:47 user nova-compute[76442]: node.session.auth.password = ***
Nov 14 20:39:47 user nova-compute[76442]: node.session.auth.username_in = <empty>
Nov 14 20:39:47 user nova-compute[76442]: node.session.auth.password_in = <empty>
Nov 14 20:39:47 user nova-compute[76442]: node.session.auth.chap_algs = MD5
Nov 14 20:39:47 user nova-compute[76442]: node.session.timeo.replacement_timeout = 120
Nov 14 20:39:47 user nova-compute[76442]: node.session.err_timeo.abort_timeout = 15
Nov 14 20:39:47 user nova-compute[76442]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 20:39:47 user nova-compute[76442]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 20:39:47 user nova-compute[76442]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.FastAbort = Yes
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.InitialR2T = No
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.ImmediateData = Yes
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.MaxConnections = 1
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 20:39:47 user nova-compute[76442]: node.session.iscsi.ERL = 0
Nov 14 20:39:47 user nova-compute[76442]: node.session.scan = manual
Nov 14 20:39:47 user nova-compute[76442]: node.session.reopen_max = 0
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].address = 172.16.0.220
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].port = 3260
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].startup = manual
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].tcp.window_size = 524288
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].tcp.type_of_service = 0
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].timeo.logout_timeout = 15
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].timeo.login_timeout = 15
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].timeo.auth_timeout = 45
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].iscsi.DataDigest = None
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].iscsi.IFMarker = No
Nov 14 20:39:47 user nova-compute[76442]: node.conn[0].iscsi.OFMarker = No
Nov 14 20:39:47 user nova-compute[76442]: # END RECORD
Nov 14 20:39:47 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[18129e19-0dd7-4e2f-81d8-075a9514553e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYzBlZkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:39:47 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa9b8b4-eef4-4857-8835-0e4311d3e886]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLFkYdUM {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLFkYdUM" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8600dd33-3976-417b-aebf-9de6574be802]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qLFkYdUM'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ed07dc-6805-4b8b-b4f7-71d8a2106b5d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f0a02e-86a4-4f0a-a293-d0594e24562b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.193s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[970a7e8a-97bd-40dc-8775-f821e40ad754]: (4, ('0 0 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLFkYdUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.229s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] <== connect_volume: return (546ms) {'type': 'block', 'scsi_wwn': '23131373563613739', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131373563613739', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.149s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:48 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:39:48 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-ba33a56f-667b-4ecb-bff8-e9ab362e02b5 req-4310fb69-9ec2-4786-8136-5e1522f39193 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba33a56f-667b-4ecb-bff8-e9ab362e02b5 req-4310fb69-9ec2-4786-8136-5e1522f39193 service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba33a56f-667b-4ecb-bff8-e9ab362e02b5 req-4310fb69-9ec2-4786-8136-5e1522f39193 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba33a56f-667b-4ecb-bff8-e9ab362e02b5 req-4310fb69-9ec2-4786-8136-5e1522f39193 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-ba33a56f-667b-4ecb-bff8-e9ab362e02b5 req-4310fb69-9ec2-4786-8136-5e1522f39193 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:48 user nova-compute[76442]: WARNING nova.compute.manager [req-ba33a56f-667b-4ecb-bff8-e9ab362e02b5 req-4310fb69-9ec2-4786-8136-5e1522f39193 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state active and task_state rescuing.
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:39:48 user nova-compute[76442]: INFO nova.compute.claims [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Claim successful on node user
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05b20c7-02ef-421b-aed6-04f6e7390847]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:39:48 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-408016581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-408016581',id=13,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:38:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-gtus977f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:38:09Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=5253f642-7c49-4c03-8d13-5105497b4f5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "vif_mac": "fa:16:3e:fa:28:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "vif_mac": "fa:16:3e:fa:28:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:28:05,bridge_name='br-int',has_traffic_filtering=True,id=f58fa4af-61f7-4485-8d7d-96666813d45a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58fa4af-61') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.objects.instance [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'pci_devices' on Instance uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c49f3-9d90-467d-b146-3e96ae0f6b4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35] added
Nov 14 20:39:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.objects.base [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<5253f642-7c49-4c03-8d13-5105497b4f5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:39:48 user nova-compute[76442]:   <uuid>5253f642-7c49-4c03-8d13-5105497b4f5d</uuid>
Nov 14 20:39:48 user nova-compute[76442]:   <name>instance-0000000d</name>
Nov 14 20:39:48 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:39:48 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:39:48 user nova-compute[76442]:   <metadata>
Nov 14 20:39:48 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:39:48 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:39:48 user nova-compute[76442]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-408016581</nova:name>
Nov 14 20:39:48 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:39:47</nova:creationTime>
Nov 14 20:39:48 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:39:48 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:39:48 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:39:48 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:39:48 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:39:48 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:39:48 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:39:48 user nova-compute[76442]:       <nova:owner>
Nov 14 20:39:48 user nova-compute[76442]:         <nova:user uuid="4163211b006c4fbbbdc575c0e6d02ac8">tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member</nova:user>
Nov 14 20:39:48 user nova-compute[76442]:         <nova:project uuid="f83568ed733848d09643843927ca0c42">tempest-ServerBootFromVolumeStableRescueTest-1547619353</nova:project>
Nov 14 20:39:48 user nova-compute[76442]:       </nova:owner>
Nov 14 20:39:48 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:39:48 user nova-compute[76442]:       <nova:ports>
Nov 14 20:39:48 user nova-compute[76442]:         <nova:port uuid="f58fa4af-61f7-4485-8d7d-96666813d45a">
Nov 14 20:39:48 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 20:39:48 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:48 user nova-compute[76442]:       </nova:ports>
Nov 14 20:39:48 user nova-compute[76442]:     </nova:instance>
Nov 14 20:39:48 user nova-compute[76442]:   </metadata>
Nov 14 20:39:48 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:39:48 user nova-compute[76442]:     <system>
Nov 14 20:39:48 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:39:48 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:39:48 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:39:48 user nova-compute[76442]:       <entry name="serial">5253f642-7c49-4c03-8d13-5105497b4f5d</entry>
Nov 14 20:39:48 user nova-compute[76442]:       <entry name="uuid">5253f642-7c49-4c03-8d13-5105497b4f5d</entry>
Nov 14 20:39:48 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:39:48 user nova-compute[76442]:     </system>
Nov 14 20:39:48 user nova-compute[76442]:   </sysinfo>
Nov 14 20:39:48 user nova-compute[76442]:   <os>
Nov 14 20:39:48 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:39:48 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:39:48 user nova-compute[76442]:   </os>
Nov 14 20:39:48 user nova-compute[76442]:   <features>
Nov 14 20:39:48 user nova-compute[76442]:     <acpi/>
Nov 14 20:39:48 user nova-compute[76442]:     <apic/>
Nov 14 20:39:48 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:39:48 user nova-compute[76442]:   </features>
Nov 14 20:39:48 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:39:48 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:39:48 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:39:48 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:39:48 user nova-compute[76442]:   </clock>
Nov 14 20:39:48 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:39:48 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:39:48 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:39:48 user nova-compute[76442]:   </cpu>
Nov 14 20:39:48 user nova-compute[76442]:   <devices>
Nov 14 20:39:48 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:39:48 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:39:48 user nova-compute[76442]:       <source dev="/dev/sdb"/>
Nov 14 20:39:48 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:39:48 user nova-compute[76442]:       <serial>2f1e11e0-aaef-47a6-ac09-77d6960195d6</serial>
Nov 14 20:39:48 user nova-compute[76442]:     </disk>
Nov 14 20:39:48 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:39:48 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:39:48 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue"/>
Nov 14 20:39:48 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:39:48 user nova-compute[76442]:       <boot order="1"/>
Nov 14 20:39:48 user nova-compute[76442]:     </disk>
Nov 14 20:39:48 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:48 user nova-compute[76442]:       <mac address="fa:16:3e:fa:28:05"/>
Nov 14 20:39:48 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:48 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:48 user nova-compute[76442]:       <target dev="tapf58fa4af-61"/>
Nov 14 20:39:48 user nova-compute[76442]:     </interface>
Nov 14 20:39:48 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:39:48 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/console.log" append="off"/>
Nov 14 20:39:48 user nova-compute[76442]:     </serial>
Nov 14 20:39:48 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:39:48 user nova-compute[76442]:     <video>
Nov 14 20:39:48 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:48 user nova-compute[76442]:     </video>
Nov 14 20:39:48 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:39:48 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:39:48 user nova-compute[76442]:     </rng>
Nov 14 20:39:48 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:39:48 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:39:48 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:39:48 user nova-compute[76442]:     </memballoon>
Nov 14 20:39:48 user nova-compute[76442]:   </devices>
Nov 14 20:39:48 user nova-compute[76442]: </domain>
Nov 14 20:39:48 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c594ee2-72ef-4bac-aa8d-0f67ec17ed04]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Instance destroyed successfully.
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ed5c7-9985-41bc-9680-cb53900564e0]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYzBlZkb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYzBlZkb" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4880240-28db-4da8-bde3-61aa2a66bb88]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYzBlZkb'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No VIF found with MAC fa:16:3e:fa:28:05, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.225s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c5b96-5dd9-4fa1-85e7-64107df31a8a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f0154e-1eab-43d3-85fe-e1ca5b320d36]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4db999f-c0df-464f-84e1-abc5a322cfbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35, portal: 172.16.0.220,3260]
Nov 14 20:39:48 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35, portal: 172.16.0.220,3260] successful.
Nov 14 20:39:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d589605d-d4b8-436c-b37a-e6c8965a0cd7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb9aff-622c-45e6-930b-16a94a849d64]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:39:48 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:39:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.582s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c000ef92-5057-47d6-8f69-0860a27cc3fb]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYzBlZkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.842s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:39:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:39:49 user nova-compute[76442]: INFO nova.compute.claims [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Claim successful on node user
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.policy [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d5a850b0e6c48359f78aa669b038897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7950cfcf40b180d65bc96e28a2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:39:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Creating image(s)
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.200s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.213s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk 1073741824" returned: 0 in 0.058s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.631s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] <== connect_volume: return (1781ms) {'type': 'block', 'scsi_wwn': '26332666661663834', 'path': '/dev/sdh'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332666661663834', 'path': '/dev/sdh'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:39:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:42:93,bridge_name='br-int',has_traffic_filtering=True,id=2e91aa0a-5a60-4adc-9ec7-50814a3918fd,network=Network(81ba528b-1bbc-4964-8dfb-439b434d0c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e91aa0a-5a') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:72:c2,bridge_name='br-int',has_traffic_filtering=True,id=8fb1678c-0972-4bbe-98a4-67677ac6e2d2,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fb1678c-09') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:18:bd,bridge_name='br-int',has_traffic_filtering=True,id=8c570d93-b917-4c24-a002-876b00044b1c,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c570d93-b9') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=c1f45401-6091-40a4-b051-84ebfd71b966,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f45401-60') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:90:2a,bridge_name='br-int',has_traffic_filtering=True,id=450fa94f-63d9-46f5-a4e8-69af6585df23,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450fa94f-63') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:23:83,bridge_name='br-int',has_traffic_filtering=True,id=93a5bd0e-57a0-4a08-811c-dc9a12a06e54,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a5bd0e-57') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:06,bridge_name='br-int',has_traffic_filtering=True,id=ec963ded-b534-4f97-b8df-4257671d2fe9,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec963ded-b5') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.objects.instance [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lazy-loading 'pci_devices' on Instance uuid af2fc78b-7d41-4aed-88a2-ebf2952a0af7 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:39:49 user nova-compute[76442]:   <uuid>af2fc78b-7d41-4aed-88a2-ebf2952a0af7</uuid>
Nov 14 20:39:49 user nova-compute[76442]:   <name>instance-00000011</name>
Nov 14 20:39:49 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:39:49 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:39:49 user nova-compute[76442]:   <metadata>
Nov 14 20:39:49 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:39:49 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:39:49 user nova-compute[76442]:       <nova:name>tempest-device-tagging-server-113320294</nova:name>
Nov 14 20:39:49 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:39:43</nova:creationTime>
Nov 14 20:39:49 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:39:49 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:39:49 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:39:49 user nova-compute[76442]:       <nova:owner>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:user uuid="1d6015fa259d4659afce1794a9e3de38">tempest-TaggedBootDevicesTest-542333708-project-member</nova:user>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:project uuid="c2e62fa5383e4a83aff08bfd6ac92f1a">tempest-TaggedBootDevicesTest-542333708</nova:project>
Nov 14 20:39:49 user nova-compute[76442]:       </nova:owner>
Nov 14 20:39:49 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:39:49 user nova-compute[76442]:       <nova:ports>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:port uuid="2e91aa0a-5a60-4adc-9ec7-50814a3918fd">
Nov 14 20:39:49 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:39:49 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:port uuid="8fb1678c-0972-4bbe-98a4-67677ac6e2d2">
Nov 14 20:39:49 user nova-compute[76442]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Nov 14 20:39:49 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:port uuid="8c570d93-b917-4c24-a002-876b00044b1c">
Nov 14 20:39:49 user nova-compute[76442]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Nov 14 20:39:49 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:port uuid="c1f45401-6091-40a4-b051-84ebfd71b966">
Nov 14 20:39:49 user nova-compute[76442]:           <nova:ip type="fixed" address="10.1.1.201" ipVersion="4"/>
Nov 14 20:39:49 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:port uuid="450fa94f-63d9-46f5-a4e8-69af6585df23">
Nov 14 20:39:49 user nova-compute[76442]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Nov 14 20:39:49 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:port uuid="93a5bd0e-57a0-4a08-811c-dc9a12a06e54">
Nov 14 20:39:49 user nova-compute[76442]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 20:39:49 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:49 user nova-compute[76442]:         <nova:port uuid="ec963ded-b534-4f97-b8df-4257671d2fe9">
Nov 14 20:39:49 user nova-compute[76442]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 20:39:49 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:49 user nova-compute[76442]:       </nova:ports>
Nov 14 20:39:49 user nova-compute[76442]:     </nova:instance>
Nov 14 20:39:49 user nova-compute[76442]:   </metadata>
Nov 14 20:39:49 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:39:49 user nova-compute[76442]:     <system>
Nov 14 20:39:49 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:39:49 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:39:49 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:39:49 user nova-compute[76442]:       <entry name="serial">af2fc78b-7d41-4aed-88a2-ebf2952a0af7</entry>
Nov 14 20:39:49 user nova-compute[76442]:       <entry name="uuid">af2fc78b-7d41-4aed-88a2-ebf2952a0af7</entry>
Nov 14 20:39:49 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:39:49 user nova-compute[76442]:     </system>
Nov 14 20:39:49 user nova-compute[76442]:   </sysinfo>
Nov 14 20:39:49 user nova-compute[76442]:   <os>
Nov 14 20:39:49 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:39:49 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:39:49 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:39:49 user nova-compute[76442]:   </os>
Nov 14 20:39:49 user nova-compute[76442]:   <features>
Nov 14 20:39:49 user nova-compute[76442]:     <acpi/>
Nov 14 20:39:49 user nova-compute[76442]:     <apic/>
Nov 14 20:39:49 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:39:49 user nova-compute[76442]:   </features>
Nov 14 20:39:49 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:39:49 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:39:49 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:39:49 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:39:49 user nova-compute[76442]:   </clock>
Nov 14 20:39:49 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:39:49 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:39:49 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:39:49 user nova-compute[76442]:   </cpu>
Nov 14 20:39:49 user nova-compute[76442]:   <devices>
Nov 14 20:39:49 user nova-compute[76442]:     <disk type="file" device="cdrom">
Nov 14 20:39:49 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 20:39:49 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/af2fc78b-7d41-4aed-88a2-ebf2952a0af7/disk.config"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="hda" bus="ide"/>
Nov 14 20:39:49 user nova-compute[76442]:     </disk>
Nov 14 20:39:49 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:39:49 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:39:49 user nova-compute[76442]:       <source dev="/dev/sdf"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <serial>ffd9b893-a2d4-4b22-b7d7-857f130c05fc</serial>
Nov 14 20:39:49 user nova-compute[76442]:     </disk>
Nov 14 20:39:49 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:39:49 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:39:49 user nova-compute[76442]:       <source dev="/dev/sdg"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <serial>ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69</serial>
Nov 14 20:39:49 user nova-compute[76442]:     </disk>
Nov 14 20:39:49 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:39:49 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:39:49 user nova-compute[76442]:       <source dev="/dev/sdh"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="vdc" bus="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <serial>692a6d7e-d181-4b0b-9f67-019aab85ef35</serial>
Nov 14 20:39:49 user nova-compute[76442]:     </disk>
Nov 14 20:39:49 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:49 user nova-compute[76442]:       <mac address="fa:16:3e:3b:42:93"/>
Nov 14 20:39:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="tap2e91aa0a-5a"/>
Nov 14 20:39:49 user nova-compute[76442]:     </interface>
Nov 14 20:39:49 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:49 user nova-compute[76442]:       <mac address="fa:16:3e:c5:72:c2"/>
Nov 14 20:39:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="tap8fb1678c-09"/>
Nov 14 20:39:49 user nova-compute[76442]:     </interface>
Nov 14 20:39:49 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:49 user nova-compute[76442]:       <mac address="fa:16:3e:97:18:bd"/>
Nov 14 20:39:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="tap8c570d93-b9"/>
Nov 14 20:39:49 user nova-compute[76442]:     </interface>
Nov 14 20:39:49 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:49 user nova-compute[76442]:       <mac address="fa:16:3e:2e:ee:b0"/>
Nov 14 20:39:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="tapc1f45401-60"/>
Nov 14 20:39:49 user nova-compute[76442]:     </interface>
Nov 14 20:39:49 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:49 user nova-compute[76442]:       <mac address="fa:16:3e:f4:90:2a"/>
Nov 14 20:39:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="tap450fa94f-63"/>
Nov 14 20:39:49 user nova-compute[76442]:     </interface>
Nov 14 20:39:49 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:49 user nova-compute[76442]:       <mac address="fa:16:3e:55:23:83"/>
Nov 14 20:39:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="tap93a5bd0e-57"/>
Nov 14 20:39:49 user nova-compute[76442]:     </interface>
Nov 14 20:39:49 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:49 user nova-compute[76442]:       <mac address="fa:16:3e:0e:74:06"/>
Nov 14 20:39:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:49 user nova-compute[76442]:       <target dev="tapec963ded-b5"/>
Nov 14 20:39:49 user nova-compute[76442]:     </interface>
Nov 14 20:39:49 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:39:49 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/af2fc78b-7d41-4aed-88a2-ebf2952a0af7/console.log" append="off"/>
Nov 14 20:39:49 user nova-compute[76442]:     </serial>
Nov 14 20:39:49 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:39:49 user nova-compute[76442]:     <video>
Nov 14 20:39:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:49 user nova-compute[76442]:     </video>
Nov 14 20:39:49 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:39:49 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:39:49 user nova-compute[76442]:     </rng>
Nov 14 20:39:49 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:39:49 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:39:49 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:39:49 user nova-compute[76442]:     </memballoon>
Nov 14 20:39:49 user nova-compute[76442]:   </devices>
Nov 14 20:39:49 user nova-compute[76442]: </domain>
Nov 14 20:39:49 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:42:93,bridge_name='br-int',has_traffic_filtering=True,id=2e91aa0a-5a60-4adc-9ec7-50814a3918fd,network=Network(81ba528b-1bbc-4964-8dfb-439b434d0c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e91aa0a-5a') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:42:93,bridge_name='br-int',has_traffic_filtering=True,id=2e91aa0a-5a60-4adc-9ec7-50814a3918fd,network=Network(81ba528b-1bbc-4964-8dfb-439b434d0c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e91aa0a-5a') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f881360e-ac52-55ad-a328-50951588863a', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e91aa0a-5a, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e91aa0a-5a, col_values=(('qos', UUID('bff0bbea-9520-49c9-bf44-13e17fd9b44f')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e91aa0a-5a, col_values=(('external_ids', {'iface-id': '2e91aa0a-5a60-4adc-9ec7-50814a3918fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:42:93', 'vm-uuid': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: INFO os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:42:93,bridge_name='br-int',has_traffic_filtering=True,id=2e91aa0a-5a60-4adc-9ec7-50814a3918fd,network=Network(81ba528b-1bbc-4964-8dfb-439b434d0c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e91aa0a-5a')
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:72:c2,bridge_name='br-int',has_traffic_filtering=True,id=8fb1678c-0972-4bbe-98a4-67677ac6e2d2,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fb1678c-09') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:72:c2,bridge_name='br-int',has_traffic_filtering=True,id=8fb1678c-0972-4bbe-98a4-67677ac6e2d2,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fb1678c-09') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.policy [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d5a850b0e6c48359f78aa669b038897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7950cfcf40b180d65bc96e28a2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0142003-2d8b-594a-a139-6174f1bd912f', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.220s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fb1678c-09, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fb1678c-09, col_values=(('qos', UUID('d10c382f-55e6-43cb-bfee-078a8ab16815')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fb1678c-09, col_values=(('external_ids', {'iface-id': '8fb1678c-0972-4bbe-98a4-67677ac6e2d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:72:c2', 'vm-uuid': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:39:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Creating image(s)
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:49 user nova-compute[76442]: INFO os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:72:c2,bridge_name='br-int',has_traffic_filtering=True,id=8fb1678c-0972-4bbe-98a4-67677ac6e2d2,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fb1678c-09')
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:18:bd,bridge_name='br-int',has_traffic_filtering=True,id=8c570d93-b917-4c24-a002-876b00044b1c,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c570d93-b9') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:18:bd,bridge_name='br-int',has_traffic_filtering=True,id=8c570d93-b917-4c24-a002-876b00044b1c,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c570d93-b9') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34c49ff2-ee05-5823-980b-a7724ebb854c', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c570d93-b9, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c570d93-b9, col_values=(('qos', UUID('642f06e2-5ede-453e-831c-a58d3ba36db1')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c570d93-b9, col_values=(('external_ids', {'iface-id': '8c570d93-b917-4c24-a002-876b00044b1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:18:bd', 'vm-uuid': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Cannot resize image /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Ensure instance console log exists: /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-bcb7b412-ccab-44bc-87f4-045bc065221d req-a21b6fc7-a3b0-4f8d-ac66-f7885d9ef172 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bcb7b412-ccab-44bc-87f4-045bc065221d req-a21b6fc7-a3b0-4f8d-ac66-f7885d9ef172 service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bcb7b412-ccab-44bc-87f4-045bc065221d req-a21b6fc7-a3b0-4f8d-ac66-f7885d9ef172 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bcb7b412-ccab-44bc-87f4-045bc065221d req-a21b6fc7-a3b0-4f8d-ac66-f7885d9ef172 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-bcb7b412-ccab-44bc-87f4-045bc065221d req-a21b6fc7-a3b0-4f8d-ac66-f7885d9ef172 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:50 user nova-compute[76442]: WARNING nova.compute.manager [req-bcb7b412-ccab-44bc-87f4-045bc065221d req-a21b6fc7-a3b0-4f8d-ac66-f7885d9ef172 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state active and task_state rescuing.
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: INFO os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:18:bd,bridge_name='br-int',has_traffic_filtering=True,id=8c570d93-b917-4c24-a002-876b00044b1c,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c570d93-b9')
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=c1f45401-6091-40a4-b051-84ebfd71b966,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f45401-60') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=c1f45401-6091-40a4-b051-84ebfd71b966,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f45401-60') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.neutron [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Successfully created port: 64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73113177-794a-51d7-935c-958663efcc5f', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.291s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1f45401-60, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1f45401-60, col_values=(('qos', UUID('6581419d-5d41-41f0-9bcc-ecaa53afe254')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1f45401-60, col_values=(('external_ids', {'iface-id': 'c1f45401-6091-40a4-b051-84ebfd71b966', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:ee:b0', 'vm-uuid': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: INFO os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=c1f45401-6091-40a4-b051-84ebfd71b966,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f45401-60')
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:90:2a,bridge_name='br-int',has_traffic_filtering=True,id=450fa94f-63d9-46f5-a4e8-69af6585df23,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450fa94f-63') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:90:2a,bridge_name='br-int',has_traffic_filtering=True,id=450fa94f-63d9-46f5-a4e8-69af6585df23,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450fa94f-63') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53977698-7afb-5a36-8702-236f2cc617f8', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap450fa94f-63, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap450fa94f-63, col_values=(('qos', UUID('0bd11186-eed7-4154-95db-7b1da2cc8c61')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap450fa94f-63, col_values=(('external_ids', {'iface-id': '450fa94f-63d9-46f5-a4e8-69af6585df23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:90:2a', 'vm-uuid': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk 1073741824" returned: 0 in 0.053s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: INFO os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:90:2a,bridge_name='br-int',has_traffic_filtering=True,id=450fa94f-63d9-46f5-a4e8-69af6585df23,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450fa94f-63')
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:23:83,bridge_name='br-int',has_traffic_filtering=True,id=93a5bd0e-57a0-4a08-811c-dc9a12a06e54,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a5bd0e-57') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:23:83,bridge_name='br-int',has_traffic_filtering=True,id=93a5bd0e-57a0-4a08-811c-dc9a12a06e54,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a5bd0e-57') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '417d5966-1b82-549f-8349-474729bb6825', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93a5bd0e-57, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93a5bd0e-57, col_values=(('qos', UUID('05c2bba1-fdc5-42ef-8f97-b21d2611cb59')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93a5bd0e-57, col_values=(('external_ids', {'iface-id': '93a5bd0e-57a0-4a08-811c-dc9a12a06e54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:23:83', 'vm-uuid': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: INFO os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:23:83,bridge_name='br-int',has_traffic_filtering=True,id=93a5bd0e-57a0-4a08-811c-dc9a12a06e54,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a5bd0e-57')
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:06,bridge_name='br-int',has_traffic_filtering=True,id=ec963ded-b534-4f97-b8df-4257671d2fe9,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec963ded-b5') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:06,bridge_name='br-int',has_traffic_filtering=True,id=ec963ded-b534-4f97-b8df-4257671d2fe9,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec963ded-b5') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3284f038-bc41-5d50-9690-c45f1a2d1872', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.209s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec963ded-b5, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec963ded-b5, col_values=(('qos', UUID('14e65644-74d1-4662-87d7-aeba0a924774')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec963ded-b5, col_values=(('external_ids', {'iface-id': 'ec963ded-b534-4f97-b8df-4257671d2fe9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:74:06', 'vm-uuid': 'af2fc78b-7d41-4aed-88a2-ebf2952a0af7'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:50 user nova-compute[76442]: INFO os_vif [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:06,bridge_name='br-int',has_traffic_filtering=True,id=ec963ded-b534-4f97-b8df-4257671d2fe9,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec963ded-b5')
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Cannot resize image /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Ensure instance console log exists: /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] No BDM found with device name hda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] No VIF found with MAC fa:16:3e:3b:42:93, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] No VIF found with MAC fa:16:3e:f4:90:2a, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:39:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Using config drive
Nov 14 20:39:50 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Successfully created port: 54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Successfully updated port: 64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquired lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-2e892208-eab1-49d5-bd22-fd0e4dc383e5 req-5f375d1b-4023-408b-a19f-4d85469b535f service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-changed-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-2e892208-eab1-49d5-bd22-fd0e4dc383e5 req-5f375d1b-4023-408b-a19f-4d85469b535f service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Refreshing instance network info cache due to event network-changed-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2e892208-eab1-49d5-bd22-fd0e4dc383e5 req-5f375d1b-4023-408b-a19f-4d85469b535f service nova] Acquiring lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:51 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Creating config drive at /opt/stack/data/nova/instances/af2fc78b-7d41-4aed-88a2-ebf2952a0af7/disk.config
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/af2fc78b-7d41-4aed-88a2-ebf2952a0af7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjhphilcz {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updating instance_info_cache with network_info: [{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/af2fc78b-7d41-4aed-88a2-ebf2952a0af7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjhphilcz" returned: 0 in 0.058s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Releasing lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Instance network_info: |[{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2e892208-eab1-49d5-bd22-fd0e4dc383e5 req-5f375d1b-4023-408b-a19f-4d85469b535f service nova] Acquired lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.neutron [req-2e892208-eab1-49d5-bd22-fd0e4dc383e5 req-5f375d1b-4023-408b-a19f-4d85469b535f service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Refreshing network info cache for port 64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Start _get_guest_xml network_info=[{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:39:51 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:51 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-44444427',display_name='tempest-ServerRescueNegativeTestJSON-server-44444427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-44444427',id=18,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-59ap0w1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:49Z,user_data=None,user_id='5d5a850b0e6c48359f78aa669b038897',uuid=ceeb436d-1451-4477-8f02-60d1e3a52d93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:61:bc,bridge_name='br-int',has_traffic_filtering=True,id=64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3e9a-8d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.objects.instance [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'pci_devices' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:39:51 user nova-compute[76442]:   <uuid>ceeb436d-1451-4477-8f02-60d1e3a52d93</uuid>
Nov 14 20:39:51 user nova-compute[76442]:   <name>instance-00000012</name>
Nov 14 20:39:51 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:39:51 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:39:51 user nova-compute[76442]:   <metadata>
Nov 14 20:39:51 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:39:51 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:39:51 user nova-compute[76442]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-44444427</nova:name>
Nov 14 20:39:51 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:39:51</nova:creationTime>
Nov 14 20:39:51 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:39:51 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:39:51 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:39:51 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:39:51 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:39:51 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:39:51 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:39:51 user nova-compute[76442]:       <nova:owner>
Nov 14 20:39:51 user nova-compute[76442]:         <nova:user uuid="5d5a850b0e6c48359f78aa669b038897">tempest-ServerRescueNegativeTestJSON-916964129-project-member</nova:user>
Nov 14 20:39:51 user nova-compute[76442]:         <nova:project uuid="69cc7950cfcf40b180d65bc96e28a2e3">tempest-ServerRescueNegativeTestJSON-916964129</nova:project>
Nov 14 20:39:51 user nova-compute[76442]:       </nova:owner>
Nov 14 20:39:51 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:39:51 user nova-compute[76442]:       <nova:ports>
Nov 14 20:39:51 user nova-compute[76442]:         <nova:port uuid="64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9">
Nov 14 20:39:51 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 20:39:51 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:51 user nova-compute[76442]:       </nova:ports>
Nov 14 20:39:51 user nova-compute[76442]:     </nova:instance>
Nov 14 20:39:51 user nova-compute[76442]:   </metadata>
Nov 14 20:39:51 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:39:51 user nova-compute[76442]:     <system>
Nov 14 20:39:51 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:39:51 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:39:51 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:39:51 user nova-compute[76442]:       <entry name="serial">ceeb436d-1451-4477-8f02-60d1e3a52d93</entry>
Nov 14 20:39:51 user nova-compute[76442]:       <entry name="uuid">ceeb436d-1451-4477-8f02-60d1e3a52d93</entry>
Nov 14 20:39:51 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:39:51 user nova-compute[76442]:     </system>
Nov 14 20:39:51 user nova-compute[76442]:   </sysinfo>
Nov 14 20:39:51 user nova-compute[76442]:   <os>
Nov 14 20:39:51 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:39:51 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:39:51 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:39:51 user nova-compute[76442]:   </os>
Nov 14 20:39:51 user nova-compute[76442]:   <features>
Nov 14 20:39:51 user nova-compute[76442]:     <acpi/>
Nov 14 20:39:51 user nova-compute[76442]:     <apic/>
Nov 14 20:39:51 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:39:51 user nova-compute[76442]:   </features>
Nov 14 20:39:51 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:39:51 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:39:51 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:39:51 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:39:51 user nova-compute[76442]:   </clock>
Nov 14 20:39:51 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:39:51 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:39:51 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:39:51 user nova-compute[76442]:   </cpu>
Nov 14 20:39:51 user nova-compute[76442]:   <devices>
Nov 14 20:39:51 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:39:51 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:39:51 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk"/>
Nov 14 20:39:51 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:39:51 user nova-compute[76442]:     </disk>
Nov 14 20:39:51 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:51 user nova-compute[76442]:       <mac address="fa:16:3e:6e:61:bc"/>
Nov 14 20:39:51 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:51 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:51 user nova-compute[76442]:       <target dev="tap64ae3e9a-8d"/>
Nov 14 20:39:51 user nova-compute[76442]:     </interface>
Nov 14 20:39:51 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:39:51 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/console.log" append="off"/>
Nov 14 20:39:51 user nova-compute[76442]:     </serial>
Nov 14 20:39:51 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:39:51 user nova-compute[76442]:     <video>
Nov 14 20:39:51 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:51 user nova-compute[76442]:     </video>
Nov 14 20:39:51 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:39:51 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:39:51 user nova-compute[76442]:     </rng>
Nov 14 20:39:51 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:39:51 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:39:51 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:39:51 user nova-compute[76442]:     </memballoon>
Nov 14 20:39:51 user nova-compute[76442]:   </devices>
Nov 14 20:39:51 user nova-compute[76442]: </domain>
Nov 14 20:39:51 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-44444427',display_name='tempest-ServerRescueNegativeTestJSON-server-44444427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-44444427',id=18,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-59ap0w1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:49Z,user_data=None,user_id='5d5a850b0e6c48359f78aa669b038897',uuid=ceeb436d-1451-4477-8f02-60d1e3a52d93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:61:bc,bridge_name='br-int',has_traffic_filtering=True,id=64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3e9a-8d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG os_vif [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:61:bc,bridge_name='br-int',has_traffic_filtering=True,id=64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3e9a-8d') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '759896c8-8690-5ea9-bfe5-07fea204f585', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Successfully updated port: 54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquired lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64ae3e9a-8d, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64ae3e9a-8d, col_values=(('qos', UUID('7bc1bdf7-6fbb-4a9b-a059-57989129cde1')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64ae3e9a-8d, col_values=(('external_ids', {'iface-id': '64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:61:bc', 'vm-uuid': 'ceeb436d-1451-4477-8f02-60d1e3a52d93'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:51 user nova-compute[76442]: INFO os_vif [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:61:bc,bridge_name='br-int',has_traffic_filtering=True,id=64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3e9a-8d')
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No VIF found with MAC fa:16:3e:6e:61:bc, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Updating instance_info_cache with network_info: [{"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Releasing lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Instance network_info: |[{"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Start _get_guest_xml network_info=[{"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:39:51 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:51 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1584248445',display_name='tempest-ServerRescueNegativeTestJSON-server-1584248445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1584248445',id=19,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-oqv0u6ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:50Z,user_data=None,user_id='5d5a850b0e6c48359f78aa669b038897',uuid=f9200286-76da-4cc2-8592-c46cfbd5e83e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=54c7f1f0-36f9-40ec-9349-81a3a62afe53,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c7f1f0-36') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:51 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'pci_devices' on Instance uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:39:52 user nova-compute[76442]:   <uuid>f9200286-76da-4cc2-8592-c46cfbd5e83e</uuid>
Nov 14 20:39:52 user nova-compute[76442]:   <name>instance-00000013</name>
Nov 14 20:39:52 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:39:52 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:39:52 user nova-compute[76442]:   <metadata>
Nov 14 20:39:52 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:39:52 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:39:52 user nova-compute[76442]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1584248445</nova:name>
Nov 14 20:39:52 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:39:51</nova:creationTime>
Nov 14 20:39:52 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:39:52 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:39:52 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:39:52 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:39:52 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:39:52 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:39:52 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:39:52 user nova-compute[76442]:       <nova:owner>
Nov 14 20:39:52 user nova-compute[76442]:         <nova:user uuid="5d5a850b0e6c48359f78aa669b038897">tempest-ServerRescueNegativeTestJSON-916964129-project-member</nova:user>
Nov 14 20:39:52 user nova-compute[76442]:         <nova:project uuid="69cc7950cfcf40b180d65bc96e28a2e3">tempest-ServerRescueNegativeTestJSON-916964129</nova:project>
Nov 14 20:39:52 user nova-compute[76442]:       </nova:owner>
Nov 14 20:39:52 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:39:52 user nova-compute[76442]:       <nova:ports>
Nov 14 20:39:52 user nova-compute[76442]:         <nova:port uuid="54c7f1f0-36f9-40ec-9349-81a3a62afe53">
Nov 14 20:39:52 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 20:39:52 user nova-compute[76442]:         </nova:port>
Nov 14 20:39:52 user nova-compute[76442]:       </nova:ports>
Nov 14 20:39:52 user nova-compute[76442]:     </nova:instance>
Nov 14 20:39:52 user nova-compute[76442]:   </metadata>
Nov 14 20:39:52 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:39:52 user nova-compute[76442]:     <system>
Nov 14 20:39:52 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:39:52 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:39:52 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:39:52 user nova-compute[76442]:       <entry name="serial">f9200286-76da-4cc2-8592-c46cfbd5e83e</entry>
Nov 14 20:39:52 user nova-compute[76442]:       <entry name="uuid">f9200286-76da-4cc2-8592-c46cfbd5e83e</entry>
Nov 14 20:39:52 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:39:52 user nova-compute[76442]:     </system>
Nov 14 20:39:52 user nova-compute[76442]:   </sysinfo>
Nov 14 20:39:52 user nova-compute[76442]:   <os>
Nov 14 20:39:52 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:39:52 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:39:52 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:39:52 user nova-compute[76442]:   </os>
Nov 14 20:39:52 user nova-compute[76442]:   <features>
Nov 14 20:39:52 user nova-compute[76442]:     <acpi/>
Nov 14 20:39:52 user nova-compute[76442]:     <apic/>
Nov 14 20:39:52 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:39:52 user nova-compute[76442]:   </features>
Nov 14 20:39:52 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:39:52 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:39:52 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:39:52 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:39:52 user nova-compute[76442]:   </clock>
Nov 14 20:39:52 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:39:52 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:39:52 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:39:52 user nova-compute[76442]:   </cpu>
Nov 14 20:39:52 user nova-compute[76442]:   <devices>
Nov 14 20:39:52 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:39:52 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:39:52 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk"/>
Nov 14 20:39:52 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:39:52 user nova-compute[76442]:     </disk>
Nov 14 20:39:52 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:39:52 user nova-compute[76442]:       <mac address="fa:16:3e:f4:af:b5"/>
Nov 14 20:39:52 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:52 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:39:52 user nova-compute[76442]:       <target dev="tap54c7f1f0-36"/>
Nov 14 20:39:52 user nova-compute[76442]:     </interface>
Nov 14 20:39:52 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:39:52 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/console.log" append="off"/>
Nov 14 20:39:52 user nova-compute[76442]:     </serial>
Nov 14 20:39:52 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:39:52 user nova-compute[76442]:     <video>
Nov 14 20:39:52 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:39:52 user nova-compute[76442]:     </video>
Nov 14 20:39:52 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:39:52 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:39:52 user nova-compute[76442]:     </rng>
Nov 14 20:39:52 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:39:52 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:39:52 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:39:52 user nova-compute[76442]:     </memballoon>
Nov 14 20:39:52 user nova-compute[76442]:   </devices>
Nov 14 20:39:52 user nova-compute[76442]: </domain>
Nov 14 20:39:52 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1584248445',display_name='tempest-ServerRescueNegativeTestJSON-server-1584248445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1584248445',id=19,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-oqv0u6ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:50Z,user_data=None,user_id='5d5a850b0e6c48359f78aa669b038897',uuid=f9200286-76da-4cc2-8592-c46cfbd5e83e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=54c7f1f0-36f9-40ec-9349-81a3a62afe53,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c7f1f0-36') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG os_vif [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=54c7f1f0-36f9-40ec-9349-81a3a62afe53,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c7f1f0-36') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '882c1cb3-3f82-5bde-868a-69185e47c85d', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54c7f1f0-36, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54c7f1f0-36, col_values=(('qos', UUID('710c13e5-390a-426b-939e-bd49a7cd4fb3')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54c7f1f0-36, col_values=(('external_ids', {'iface-id': '54c7f1f0-36f9-40ec-9349-81a3a62afe53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:af:b5', 'vm-uuid': 'f9200286-76da-4cc2-8592-c46cfbd5e83e'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2b8a05d0-6dd7-4157-b62f-fb7a76467e51 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.network.neutron [req-2e892208-eab1-49d5-bd22-fd0e4dc383e5 req-5f375d1b-4023-408b-a19f-4d85469b535f service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updated VIF entry in instance network info cache for port 64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.network.neutron [req-2e892208-eab1-49d5-bd22-fd0e4dc383e5 req-5f375d1b-4023-408b-a19f-4d85469b535f service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updating instance_info_cache with network_info: [{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2e892208-eab1-49d5-bd22-fd0e4dc383e5 req-5f375d1b-4023-408b-a19f-4d85469b535f service nova] Releasing lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:52 user nova-compute[76442]: INFO os_vif [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=54c7f1f0-36f9-40ec-9349-81a3a62afe53,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c7f1f0-36')
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No VIF found with MAC fa:16:3e:f4:af:b5, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:52 user nova-compute[76442]: WARNING nova.compute.manager [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state rescued and task_state None.
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-changed-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Refreshing instance network info cache due to event network-changed-54c7f1f0-36f9-40ec-9349-81a3a62afe53. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] Acquiring lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] Acquired lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.network.neutron [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Refreshing network info cache for port 54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.network.neutron [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Updated VIF entry in instance network info cache for port 54c7f1f0-36f9-40ec-9349-81a3a62afe53. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG nova.network.neutron [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Updating instance_info_cache with network_info: [{"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:39:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0fbfbda1-1220-483a-ae9c-1a4f7fc38fc6 req-2431d3d0-c3b3-489a-b37c-d27b504781ce service nova] Releasing lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:39:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-234e62a2-2800-4af2-a488-3541ab34f57d req-930eda0e-1d0f-43a4-bbf9-a584845d59d8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-234e62a2-2800-4af2-a488-3541ab34f57d req-930eda0e-1d0f-43a4-bbf9-a584845d59d8 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-234e62a2-2800-4af2-a488-3541ab34f57d req-930eda0e-1d0f-43a4-bbf9-a584845d59d8 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-234e62a2-2800-4af2-a488-3541ab34f57d req-930eda0e-1d0f-43a4-bbf9-a584845d59d8 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-234e62a2-2800-4af2-a488-3541ab34f57d req-930eda0e-1d0f-43a4-bbf9-a584845d59d8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:54 user nova-compute[76442]: WARNING nova.compute.manager [req-234e62a2-2800-4af2-a488-3541ab34f57d req-930eda0e-1d0f-43a4-bbf9-a584845d59d8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state building and task_state spawning.
Nov 14 20:39:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-8af552a1-8e2f-41f1-91ad-a656c5d29f59 req-31369b1c-9849-41c6-823d-89582d75ded0 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8af552a1-8e2f-41f1-91ad-a656c5d29f59 req-31369b1c-9849-41c6-823d-89582d75ded0 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8af552a1-8e2f-41f1-91ad-a656c5d29f59 req-31369b1c-9849-41c6-823d-89582d75ded0 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8af552a1-8e2f-41f1-91ad-a656c5d29f59 req-31369b1c-9849-41c6-823d-89582d75ded0 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-8af552a1-8e2f-41f1-91ad-a656c5d29f59 req-31369b1c-9849-41c6-823d-89582d75ded0 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:55 user nova-compute[76442]: WARNING nova.compute.manager [req-8af552a1-8e2f-41f1-91ad-a656c5d29f59 req-31369b1c-9849-41c6-823d-89582d75ded0 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd for instance with vm_state building and task_state spawning.
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-50dc42f9-6601-47ca-a918-3478f8306a29 req-d15b9985-ce6b-479c-ae40-b1e51ce035e8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-50dc42f9-6601-47ca-a918-3478f8306a29 req-d15b9985-ce6b-479c-ae40-b1e51ce035e8 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-50dc42f9-6601-47ca-a918-3478f8306a29 req-d15b9985-ce6b-479c-ae40-b1e51ce035e8 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-50dc42f9-6601-47ca-a918-3478f8306a29 req-d15b9985-ce6b-479c-ae40-b1e51ce035e8 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-50dc42f9-6601-47ca-a918-3478f8306a29 req-d15b9985-ce6b-479c-ae40-b1e51ce035e8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:56 user nova-compute[76442]: WARNING nova.compute.manager [req-50dc42f9-6601-47ca-a918-3478f8306a29 req-d15b9985-ce6b-479c-ae40-b1e51ce035e8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state building and task_state spawning.
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:57 user nova-compute[76442]: INFO nova.compute.manager [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Detaching volume c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-af5acc70-0a46-4570-a65a-84e085334792 req-479a6dce-23c9-474e-a8a4-da60512f4332 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-af5acc70-0a46-4570-a65a-84e085334792 req-479a6dce-23c9-474e-a8a4-da60512f4332 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-af5acc70-0a46-4570-a65a-84e085334792 req-479a6dce-23c9-474e-a8a4-da60512f4332 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-af5acc70-0a46-4570-a65a-84e085334792 req-479a6dce-23c9-474e-a8a4-da60512f4332 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-af5acc70-0a46-4570-a65a-84e085334792 req-479a6dce-23c9-474e-a8a4-da60512f4332 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:57 user nova-compute[76442]: WARNING nova.compute.manager [req-af5acc70-0a46-4570-a65a-84e085334792 req-479a6dce-23c9-474e-a8a4-da60512f4332 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 for instance with vm_state building and task_state spawning.
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:57 user nova-compute[76442]: WARNING nova.compute.manager [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd for instance with vm_state building and task_state spawning.
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:57 user nova-compute[76442]: WARNING nova.compute.manager [req-07530652-f2fc-419a-a977-b32c0e34bada req-cd535b11-a104-4010-a1f8-0cda4d35990c service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-450fa94f-63d9-46f5-a4e8-69af6585df23 for instance with vm_state building and task_state spawning.
Nov 14 20:39:57 user nova-compute[76442]: INFO nova.virt.block_device [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Attempting to driver detach volume c0c6480a-cde4-4f36-a8da-55c28f18198b from mountpoint /dev/vdb
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Attempting to detach device vdb from instance da018992-79f4-4db3-bbf7-a492508ff629 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:39:57 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:39:57 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:39:57 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:39:57 user nova-compute[76442]:   <serial>c0c6480a-cde4-4f36-a8da-55c28f18198b</serial>
Nov 14 20:39:57 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:39:57 user nova-compute[76442]: </disk>
Nov 14 20:39:57 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:57 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully detached device vdb from instance da018992-79f4-4db3-bbf7-a492508ff629 from the persistent domain config.
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da018992-79f4-4db3-bbf7-a492508ff629 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:39:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:39:57 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:39:57 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:39:57 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:39:57 user nova-compute[76442]:   <serial>c0c6480a-cde4-4f36-a8da-55c28f18198b</serial>
Nov 14 20:39:57 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:39:57 user nova-compute[76442]: </disk>
Nov 14 20:39:57 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da018992-79f4-4db3-bbf7-a492508ff629 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:39:58 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Instance spawned successfully.
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:58 user nova-compute[76442]: WARNING nova.compute.manager [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-ec963ded-b534-4f97-b8df-4257671d2fe9 for instance with vm_state building and task_state spawning.
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:58 user nova-compute[76442]: WARNING nova.compute.manager [req-1dc32351-2d35-44d4-a9fc-df5bf19c434c req-7b12c12f-ae61-4650-9bbe-1eb8fd6368ff service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-ec963ded-b534-4f97-b8df-4257671d2fe9 for instance with vm_state building and task_state spawning.
Nov 14 20:39:58 user nova-compute[76442]: INFO nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Took 9.83 seconds to spawn the instance on the hypervisor.
Nov 14 20:39:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:39:59 user nova-compute[76442]: INFO nova.compute.manager [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Took 11.06 seconds to build instance.
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-407068a5-84d1-47c6-b48c-a97a743b0589 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.164s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:59 user nova-compute[76442]: WARNING nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 for instance with vm_state building and task_state spawning.
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:59 user nova-compute[76442]: WARNING nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state building and task_state spawning.
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:59 user nova-compute[76442]: WARNING nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state building and task_state spawning.
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:59 user nova-compute[76442]: WARNING nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-8c570d93-b917-4c24-a002-876b00044b1c for instance with vm_state building and task_state spawning.
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:59 user nova-compute[76442]: WARNING nova.compute.manager [req-c1f51bd7-9d31-4c53-bb03-90e4e5f8f0ec req-a83e4667-0a34-4cd2-bc85-cf3cc8175ca3 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-8c570d93-b917-4c24-a002-876b00044b1c for instance with vm_state building and task_state spawning.
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-0e10e000-08cb-4a46-92cc-34b0123a9947 req-dd24989d-eca6-4891-875f-9189d0b075d2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e10e000-08cb-4a46-92cc-34b0123a9947 req-dd24989d-eca6-4891-875f-9189d0b075d2 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e10e000-08cb-4a46-92cc-34b0123a9947 req-dd24989d-eca6-4891-875f-9189d0b075d2 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e10e000-08cb-4a46-92cc-34b0123a9947 req-dd24989d-eca6-4891-875f-9189d0b075d2 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:39:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-0e10e000-08cb-4a46-92cc-34b0123a9947 req-dd24989d-eca6-4891-875f-9189d0b075d2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:39:59 user nova-compute[76442]: WARNING nova.compute.manager [req-0e10e000-08cb-4a46-92cc-34b0123a9947 req-dd24989d-eca6-4891-875f-9189d0b075d2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-450fa94f-63d9-46f5-a4e8-69af6585df23 for instance with vm_state building and task_state spawning.
Nov 14 20:40:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:40:00 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Instance spawned successfully.
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:00 user nova-compute[76442]: INFO nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Took 10.34 seconds to spawn the instance on the hypervisor.
Nov 14 20:40:00 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:40:00 user nova-compute[76442]: INFO nova.compute.manager [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Took 11.40 seconds to build instance.
Nov 14 20:40:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9635ca53-2b9e-4603-a5b7-d6cf49dade1a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.541s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:40:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance spawned successfully.
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:01 user nova-compute[76442]: INFO nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Took 17.88 seconds to spawn the instance on the hypervisor.
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:01 user nova-compute[76442]: INFO nova.compute.manager [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Took 36.38 seconds to build instance.
Nov 14 20:40:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3aadd56f-bd70-4d97-860e-d27f4ef8b4aa tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.522s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "e62b2506-c519-49bd-a678-0da035a6b1a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:40:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:02 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:40:02 user nova-compute[76442]: INFO nova.compute.claims [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Claim successful on node user
Nov 14 20:40:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:02 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:40:02 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:40:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.762s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:02 user nova-compute[76442]: DEBUG nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:40:02 user nova-compute[76442]: DEBUG nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:40:02 user nova-compute[76442]: DEBUG nova.network.neutron [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:40:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:40:02 user nova-compute[76442]: DEBUG nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG nova.policy [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b873835b5e341c5aebfd4ded5f2c093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265a9c8786db48c78145d1388a5c321f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:40:03 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Creating image(s)
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "/opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "/opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "/opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.264s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk 1073741824" returned: 0 in 0.068s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.198s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:03 user nova-compute[76442]: DEBUG nova.network.neutron [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Successfully created port: 0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:40:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:04 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Cannot resize image /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:40:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:40:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Ensure instance console log exists: /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:40:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Successfully updated port: 0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquired lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-eee8d1f6-afec-4601-a368-836b6a2260bf req-5c822acb-2e33-4767-bb09-63a06458088d service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received event network-changed-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-eee8d1f6-afec-4601-a368-836b6a2260bf req-5c822acb-2e33-4767-bb09-63a06458088d service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Refreshing instance network info cache due to event network-changed-0b8cae45-a556-4485-b884-75f84893d0dd. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-eee8d1f6-afec-4601-a368-836b6a2260bf req-5c822acb-2e33-4767-bb09-63a06458088d service nova] Acquiring lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updating instance_info_cache with network_info: [{"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Releasing lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Instance network_info: |[{"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-eee8d1f6-afec-4601-a368-836b6a2260bf req-5c822acb-2e33-4767-bb09-63a06458088d service nova] Acquired lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-eee8d1f6-afec-4601-a368-836b6a2260bf req-5c822acb-2e33-4767-bb09-63a06458088d service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Refreshing network info cache for port 0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Start _get_guest_xml network_info=[{"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:40:05 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:40:05 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-714286513',display_name='tempest-ServerActionsTestOtherA-server-714286513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-714286513',id=20,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoMdApy2/8RPeA4MJeY2Nu8Fs1E5GIuT9rjXghW7E9nGEEJp3g35T0Y9hTYfuPiIewBxyfqXb2Q0ojDzSguW+OQkINVwKKH0JhOm94wxqmTbduWYc6NzfRIomyekkQ6+w==',key_name='tempest-keypair-553797527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-e95lgx1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=e62b2506-c519-49bd-a678-0da035a6b1a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0b8cae45-a556-4485-b884-75f84893d0dd,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b8cae45-a5') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.objects.instance [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'pci_devices' on Instance uuid e62b2506-c519-49bd-a678-0da035a6b1a9 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:40:05 user nova-compute[76442]:   <uuid>e62b2506-c519-49bd-a678-0da035a6b1a9</uuid>
Nov 14 20:40:05 user nova-compute[76442]:   <name>instance-00000014</name>
Nov 14 20:40:05 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:40:05 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:40:05 user nova-compute[76442]:   <metadata>
Nov 14 20:40:05 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:40:05 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:40:05 user nova-compute[76442]:       <nova:name>tempest-ServerActionsTestOtherA-server-714286513</nova:name>
Nov 14 20:40:05 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:40:05</nova:creationTime>
Nov 14 20:40:05 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:40:05 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:40:05 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:40:05 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:40:05 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:40:05 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:40:05 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:40:05 user nova-compute[76442]:       <nova:owner>
Nov 14 20:40:05 user nova-compute[76442]:         <nova:user uuid="3b873835b5e341c5aebfd4ded5f2c093">tempest-ServerActionsTestOtherA-887472165-project-member</nova:user>
Nov 14 20:40:05 user nova-compute[76442]:         <nova:project uuid="265a9c8786db48c78145d1388a5c321f">tempest-ServerActionsTestOtherA-887472165</nova:project>
Nov 14 20:40:05 user nova-compute[76442]:       </nova:owner>
Nov 14 20:40:05 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:40:05 user nova-compute[76442]:       <nova:ports>
Nov 14 20:40:05 user nova-compute[76442]:         <nova:port uuid="0b8cae45-a556-4485-b884-75f84893d0dd">
Nov 14 20:40:05 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 20:40:05 user nova-compute[76442]:         </nova:port>
Nov 14 20:40:05 user nova-compute[76442]:       </nova:ports>
Nov 14 20:40:05 user nova-compute[76442]:     </nova:instance>
Nov 14 20:40:05 user nova-compute[76442]:   </metadata>
Nov 14 20:40:05 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:40:05 user nova-compute[76442]:     <system>
Nov 14 20:40:05 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:40:05 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:40:05 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:40:05 user nova-compute[76442]:       <entry name="serial">e62b2506-c519-49bd-a678-0da035a6b1a9</entry>
Nov 14 20:40:05 user nova-compute[76442]:       <entry name="uuid">e62b2506-c519-49bd-a678-0da035a6b1a9</entry>
Nov 14 20:40:05 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:40:05 user nova-compute[76442]:     </system>
Nov 14 20:40:05 user nova-compute[76442]:   </sysinfo>
Nov 14 20:40:05 user nova-compute[76442]:   <os>
Nov 14 20:40:05 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:40:05 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:40:05 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:40:05 user nova-compute[76442]:   </os>
Nov 14 20:40:05 user nova-compute[76442]:   <features>
Nov 14 20:40:05 user nova-compute[76442]:     <acpi/>
Nov 14 20:40:05 user nova-compute[76442]:     <apic/>
Nov 14 20:40:05 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:40:05 user nova-compute[76442]:   </features>
Nov 14 20:40:05 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:40:05 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:40:05 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:40:05 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:40:05 user nova-compute[76442]:   </clock>
Nov 14 20:40:05 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:40:05 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:40:05 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:40:05 user nova-compute[76442]:   </cpu>
Nov 14 20:40:05 user nova-compute[76442]:   <devices>
Nov 14 20:40:05 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:40:05 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:40:05 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk"/>
Nov 14 20:40:05 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:40:05 user nova-compute[76442]:     </disk>
Nov 14 20:40:05 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:40:05 user nova-compute[76442]:       <mac address="fa:16:3e:1a:03:f0"/>
Nov 14 20:40:05 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:40:05 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:40:05 user nova-compute[76442]:       <target dev="tap0b8cae45-a5"/>
Nov 14 20:40:05 user nova-compute[76442]:     </interface>
Nov 14 20:40:05 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:40:05 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/console.log" append="off"/>
Nov 14 20:40:05 user nova-compute[76442]:     </serial>
Nov 14 20:40:05 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:40:05 user nova-compute[76442]:     <video>
Nov 14 20:40:05 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:40:05 user nova-compute[76442]:     </video>
Nov 14 20:40:05 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:40:05 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:40:05 user nova-compute[76442]:     </rng>
Nov 14 20:40:05 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:40:05 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:40:05 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:40:05 user nova-compute[76442]:     </memballoon>
Nov 14 20:40:05 user nova-compute[76442]:   </devices>
Nov 14 20:40:05 user nova-compute[76442]: </domain>
Nov 14 20:40:05 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-714286513',display_name='tempest-ServerActionsTestOtherA-server-714286513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-714286513',id=20,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoMdApy2/8RPeA4MJeY2Nu8Fs1E5GIuT9rjXghW7E9nGEEJp3g35T0Y9hTYfuPiIewBxyfqXb2Q0ojDzSguW+OQkINVwKKH0JhOm94wxqmTbduWYc6NzfRIomyekkQ6+w==',key_name='tempest-keypair-553797527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-e95lgx1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=e62b2506-c519-49bd-a678-0da035a6b1a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0b8cae45-a556-4485-b884-75f84893d0dd,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b8cae45-a5') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG os_vif [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0b8cae45-a556-4485-b884-75f84893d0dd,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b8cae45-a5') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1ffe501-95fe-55af-a0cb-93499c0b9cc8', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b8cae45-a5, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b8cae45-a5, col_values=(('qos', UUID('ef6c9897-709e-423f-b1b1-86897339f30c')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b8cae45-a5, col_values=(('external_ids', {'iface-id': '0b8cae45-a556-4485-b884-75f84893d0dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:03:f0', 'vm-uuid': 'e62b2506-c519-49bd-a678-0da035a6b1a9'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:05 user nova-compute[76442]: INFO os_vif [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0b8cae45-a556-4485-b884-75f84893d0dd,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b8cae45-a5')
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:40:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No VIF found with MAC fa:16:3e:1a:03:f0, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:40:06 user nova-compute[76442]: DEBUG nova.network.neutron [req-eee8d1f6-afec-4601-a368-836b6a2260bf req-5c822acb-2e33-4767-bb09-63a06458088d service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updated VIF entry in instance network info cache for port 0b8cae45-a556-4485-b884-75f84893d0dd. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:40:06 user nova-compute[76442]: DEBUG nova.network.neutron [req-eee8d1f6-afec-4601-a368-836b6a2260bf req-5c822acb-2e33-4767-bb09-63a06458088d service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updating instance_info_cache with network_info: [{"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:40:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-eee8d1f6-afec-4601-a368-836b6a2260bf req-5c822acb-2e33-4767-bb09-63a06458088d service nova] Releasing lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:40:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:07 user nova-compute[76442]: WARNING nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-c1f45401-6091-40a4-b051-84ebfd71b966 for instance with vm_state active and task_state None.
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:07 user nova-compute[76442]: WARNING nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-c1f45401-6091-40a4-b051-84ebfd71b966 for instance with vm_state active and task_state None.
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:07 user nova-compute[76442]: WARNING nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 for instance with vm_state active and task_state None.
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:07 user nova-compute[76442]: WARNING nova.compute.manager [req-9cc727a0-6a1d-414c-8056-13e8dbea1405 req-a87524b6-3c80-483c-8169-1fcca7961826 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 for instance with vm_state active and task_state None.
Nov 14 20:40:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-be3a77c4-3c89-40e9-ac5d-d1f78d36e2d1 req-a840bd9b-9123-4b6b-8fce-4ec352d440e4 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received event network-vif-plugged-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be3a77c4-3c89-40e9-ac5d-d1f78d36e2d1 req-a840bd9b-9123-4b6b-8fce-4ec352d440e4 service nova] Acquiring lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be3a77c4-3c89-40e9-ac5d-d1f78d36e2d1 req-a840bd9b-9123-4b6b-8fce-4ec352d440e4 service nova] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-be3a77c4-3c89-40e9-ac5d-d1f78d36e2d1 req-a840bd9b-9123-4b6b-8fce-4ec352d440e4 service nova] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-be3a77c4-3c89-40e9-ac5d-d1f78d36e2d1 req-a840bd9b-9123-4b6b-8fce-4ec352d440e4 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] No waiting events found dispatching network-vif-plugged-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:07 user nova-compute[76442]: WARNING nova.compute.manager [req-be3a77c4-3c89-40e9-ac5d-d1f78d36e2d1 req-a840bd9b-9123-4b6b-8fce-4ec352d440e4 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received unexpected event network-vif-plugged-0b8cae45-a556-4485-b884-75f84893d0dd for instance with vm_state building and task_state spawning.
Nov 14 20:40:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-6d5d4be4-12a6-4d29-8146-be382b61b7c3 req-85e7a0bf-23d9-4ba2-bec7-415f1ca55073 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received event network-vif-plugged-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6d5d4be4-12a6-4d29-8146-be382b61b7c3 req-85e7a0bf-23d9-4ba2-bec7-415f1ca55073 service nova] Acquiring lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6d5d4be4-12a6-4d29-8146-be382b61b7c3 req-85e7a0bf-23d9-4ba2-bec7-415f1ca55073 service nova] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6d5d4be4-12a6-4d29-8146-be382b61b7c3 req-85e7a0bf-23d9-4ba2-bec7-415f1ca55073 service nova] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-6d5d4be4-12a6-4d29-8146-be382b61b7c3 req-85e7a0bf-23d9-4ba2-bec7-415f1ca55073 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] No waiting events found dispatching network-vif-plugged-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:09 user nova-compute[76442]: WARNING nova.compute.manager [req-6d5d4be4-12a6-4d29-8146-be382b61b7c3 req-85e7a0bf-23d9-4ba2-bec7-415f1ca55073 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received unexpected event network-vif-plugged-0b8cae45-a556-4485-b884-75f84893d0dd for instance with vm_state building and task_state spawning.
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:40:09 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Instance spawned successfully.
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:40:09 user nova-compute[76442]: INFO nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 14 20:40:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:40:10 user nova-compute[76442]: INFO nova.compute.manager [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Took 8.05 seconds to build instance.
Nov 14 20:40:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-940903a5-76fd-44e8-856f-024f99cbcad0 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.180s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:11 user nova-compute[76442]: INFO nova.compute.manager [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Terminating instance
Nov 14 20:40:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-06e91817-6e88-4166-91af-fa40040ee43d req-d026f670-acfb-4562-906f-8974d8ae598e service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received event network-vif-unplugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-06e91817-6e88-4166-91af-fa40040ee43d req-d026f670-acfb-4562-906f-8974d8ae598e service nova] Acquiring lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-06e91817-6e88-4166-91af-fa40040ee43d req-d026f670-acfb-4562-906f-8974d8ae598e service nova] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-06e91817-6e88-4166-91af-fa40040ee43d req-d026f670-acfb-4562-906f-8974d8ae598e service nova] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-06e91817-6e88-4166-91af-fa40040ee43d req-d026f670-acfb-4562-906f-8974d8ae598e service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] No waiting events found dispatching network-vif-unplugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-06e91817-6e88-4166-91af-fa40040ee43d req-d026f670-acfb-4562-906f-8974d8ae598e service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received event network-vif-unplugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:40:12 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Instance destroyed successfully.
Nov 14 20:40:12 user nova-compute[76442]: DEBUG nova.objects.instance [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lazy-loading 'resources' on Instance uuid 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1410097376',display_name='tempest-VolumesAdminNegativeTest-server-1410097376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1410097376',id=14,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f754011c54964adcb6898beac89668e1',ramdisk_id='',reservation_id='r-8ldc040w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1803889283',owner_user_name='tempest-VolumesAdminNegativeTest-1803889283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:38:22Z,user_data=None,user_id='6a9c7939d95a4ec1b47672c31de2330a',uuid=8ba9a4fd-19ca-49f2-b725-cec9817fc9ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converting VIF {"id": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "address": "fa:16:3e:d5:aa:15", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3bc7fee-f3", "ovs_interfaceid": "b3bc7fee-f3b9-4630-8be2-2b8d3f81e944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=b3bc7fee-f3b9-4630-8be2-2b8d3f81e944,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc7fee-f3') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG os_vif [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=b3bc7fee-f3b9-4630-8be2-2b8d3f81e944,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc7fee-f3') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3bc7fee-f3, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3eabfdc4-6a06-47a0-9b96-b0e3cab02881) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:12 user nova-compute[76442]: INFO os_vif [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=b3bc7fee-f3b9-4630-8be2-2b8d3f81e944,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3bc7fee-f3')
Nov 14 20:40:12 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Deleting instance files /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad_del
Nov 14 20:40:12 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Deletion of /opt/stack/data/nova/instances/8ba9a4fd-19ca-49f2-b725-cec9817fc9ad_del complete
Nov 14 20:40:12 user nova-compute[76442]: INFO nova.compute.manager [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 20:40:12 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:40:12 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Took 0.47 seconds to deallocate network for instance.
Nov 14 20:40:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-800044f4-89a9-4d7f-bc9c-00c70ca8b269 req-a52be5b4-31b2-42e7-9594-23e51d4382e3 service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received event network-vif-deleted-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:13 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:40:13 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:40:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:13 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Deleted allocations for instance 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad
Nov 14 20:40:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d5779180-fb0c-4d6f-93fe-4f2049cb595b tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.184s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-e778bbf1-2dc7-4968-bb9d-d3085be48852 req-f5222a4c-0367-46bc-ab7a-021ec9e5a4dc service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received event network-vif-plugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e778bbf1-2dc7-4968-bb9d-d3085be48852 req-f5222a4c-0367-46bc-ab7a-021ec9e5a4dc service nova] Acquiring lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e778bbf1-2dc7-4968-bb9d-d3085be48852 req-f5222a4c-0367-46bc-ab7a-021ec9e5a4dc service nova] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e778bbf1-2dc7-4968-bb9d-d3085be48852 req-f5222a4c-0367-46bc-ab7a-021ec9e5a4dc service nova] Lock "8ba9a4fd-19ca-49f2-b725-cec9817fc9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-e778bbf1-2dc7-4968-bb9d-d3085be48852 req-f5222a4c-0367-46bc-ab7a-021ec9e5a4dc service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] No waiting events found dispatching network-vif-plugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:14 user nova-compute[76442]: WARNING nova.compute.manager [req-e778bbf1-2dc7-4968-bb9d-d3085be48852 req-f5222a4c-0367-46bc-ab7a-021ec9e5a4dc service nova] [instance: 8ba9a4fd-19ca-49f2-b725-cec9817fc9ad] Received unexpected event network-vif-plugged-b3bc7fee-f3b9-4630-8be2-2b8d3f81e944 for instance with vm_state deleted and task_state None.
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating instance_info_cache with network_info: [{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:40:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da018992-79f4-4db3-bbf7-a492508ff629 is timed out.
Nov 14 20:40:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully detached device vdb from instance da018992-79f4-4db3-bbf7-a492508ff629 from the live domain config.
Nov 14 20:40:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPLCEwIv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:40:18 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e797a6-2adf-45d2-8948-1abab9ffa4be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:40:18 user nova-compute[76442]: No targets found.
Nov 14 20:40:18 user nova-compute[76442]: iSNS:
Nov 14 20:40:18 user nova-compute[76442]: No targets found.
Nov 14 20:40:18 user nova-compute[76442]: STATIC:
Nov 14 20:40:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b
Nov 14 20:40:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:40:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:40:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:40:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:40:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:40:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69
Nov 14 20:40:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:40:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:40:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35
Nov 14 20:40:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:40:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:40:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:40:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:40:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:40:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc
Nov 14 20:40:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:40:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:40:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:40:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:40:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:40:18 user nova-compute[76442]: FIRMWARE:
Nov 14 20:40:18 user nova-compute[76442]: No targets found.
Nov 14 20:40:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:40:18 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:40:18 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0045dc-b990-4812-af0d-02e9456c60b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3f514e-3cdb-4d59-8f12-2ac38e1abd95]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:40:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:40:18 user nova-compute[76442]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b (non-flash)
Nov 14 20:40:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4e6c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b'): ({'sde'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Removing single pathed devices sde {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[065ad7ed-17f7-468b-8e0f-49b8401e2cf0]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3543a5ef-cccb-4614-9b25-c25a4fc74803]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flushing IO for device /dev/sde {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9cb4ad-868c-4c20-912c-ccd02bc4993d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55c5a35-2fd1-44e7-8247-899568d400b2]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f495a9b4-3776-4c9e-9a31-7299ab221723]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ce3a4b-2326-4ffd-bf64-d4b234a8dcc9]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b, portal: 172.16.0.220,3260]
Nov 14 20:40:18 user nova-compute[76442]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b, portal: 172.16.0.220,3260] successful.
Nov 14 20:40:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0c6480a-cde4-4f36-a8da-55c28f18198b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa80271-0a15-4083-8bd7-61a8c7b6d9f3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] <== disconnect_volume: return (361ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk.rescue --force-share --output=json" returned: 0 in 0.272s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:40:19 user nova-compute[76442]: DEBUG nova.objects.instance [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'flavor' on Instance uuid da018992-79f4-4db3-bbf7-a492508ff629 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:40:20 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:40:20 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7131MB free_disk=25.19200897216797GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2b318127-97e7-4a19-b3c9-7b4290b9c5c1 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.802s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance da018992-79f4-4db3-bbf7-a492508ff629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a7a0fef1-0074-4b13-8e19-880a1333cc95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 31c7399a-07f6-40d7-a62c-8fa374193ba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance af2fc78b-7d41-4aed-88a2-ebf2952a0af7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:40:20 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:40:21 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:40:21 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:40:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:40:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.828s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-709de5f1-be02-48db-86dd-9a85fa31770e req-092ea045-f5f5-4a67-9f94-9b9e576d18c6 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received event network-changed-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-709de5f1-be02-48db-86dd-9a85fa31770e req-092ea045-f5f5-4a67-9f94-9b9e576d18c6 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Refreshing instance network info cache due to event network-changed-07a30840-414e-4ca8-818c-d9e3b3d9e85e. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:40:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-709de5f1-be02-48db-86dd-9a85fa31770e req-092ea045-f5f5-4a67-9f94-9b9e576d18c6 service nova] Acquiring lock "refresh_cache-a7a0fef1-0074-4b13-8e19-880a1333cc95" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:40:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-709de5f1-be02-48db-86dd-9a85fa31770e req-092ea045-f5f5-4a67-9f94-9b9e576d18c6 service nova] Acquired lock "refresh_cache-a7a0fef1-0074-4b13-8e19-880a1333cc95" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:40:43 user nova-compute[76442]: DEBUG nova.network.neutron [req-709de5f1-be02-48db-86dd-9a85fa31770e req-092ea045-f5f5-4a67-9f94-9b9e576d18c6 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Refreshing network info cache for port 07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG nova.network.neutron [req-709de5f1-be02-48db-86dd-9a85fa31770e req-092ea045-f5f5-4a67-9f94-9b9e576d18c6 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Updated VIF entry in instance network info cache for port 07a30840-414e-4ca8-818c-d9e3b3d9e85e. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG nova.network.neutron [req-709de5f1-be02-48db-86dd-9a85fa31770e req-092ea045-f5f5-4a67-9f94-9b9e576d18c6 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Updating instance_info_cache with network_info: [{"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-709de5f1-be02-48db-86dd-9a85fa31770e req-092ea045-f5f5-4a67-9f94-9b9e576d18c6 service nova] Releasing lock "refresh_cache-a7a0fef1-0074-4b13-8e19-880a1333cc95" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG nova.objects.instance [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lazy-loading 'flavor' on Instance uuid a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:44 user nova-compute[76442]: INFO nova.compute.manager [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Attaching volume 80d15607-6f9e-4a9e-97c6-cf990b85439b to /dev/vdb
Nov 14 20:40:44 user nova-compute[76442]: DEBUG os_brick.utils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[20486f8a-ce31-40cf-a650-c12a4c27c832]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d225c98d-3e34-4a56-aaae-3620628118d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f9bacb-3bc0-40ad-a180-244cc5fb45ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b98c14-e7d2-4e1d-b31e-7191ec8dc690]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:40:44 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:40:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39fbb82-dc35-43c9-81bd-2550ef490b93]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG os_brick.utils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:40:44 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Updating existing volume attachment record: 30651fcd-3cd7-4a53-9db2-e878b0d5ea40 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:40:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:48 user nova-compute[76442]: INFO nova.compute.manager [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Terminating instance
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-f0f28146-fc05-4a83-947a-50a53f5cd537 req-e2c01dc4-b682-43c5-84ca-f5a36ead7811 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received event network-vif-unplugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f0f28146-fc05-4a83-947a-50a53f5cd537 req-e2c01dc4-b682-43c5-84ca-f5a36ead7811 service nova] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f0f28146-fc05-4a83-947a-50a53f5cd537 req-e2c01dc4-b682-43c5-84ca-f5a36ead7811 service nova] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f0f28146-fc05-4a83-947a-50a53f5cd537 req-e2c01dc4-b682-43c5-84ca-f5a36ead7811 service nova] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-f0f28146-fc05-4a83-947a-50a53f5cd537 req-e2c01dc4-b682-43c5-84ca-f5a36ead7811 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] No waiting events found dispatching network-vif-unplugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-f0f28146-fc05-4a83-947a-50a53f5cd537 req-e2c01dc4-b682-43c5-84ca-f5a36ead7811 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received event network-vif-unplugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Instance destroyed successfully.
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'resources' on Instance uuid da018992-79f4-4db3-bbf7-a492508ff629 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1672825965',display_name='tempest-AttachVolumeNegativeTest-server-1672825965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1672825965',id=3,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwwqcyICyRAN6CXNbGQ9iWnzA5ha8Vk9Xh/gBJpISnDSLZ3e3UCyLQavfYVow6BiCcdVFCaHNBGj39koRaWmmtBFZfVqIZezY4cDJt/rP+eOoNcChp42UhE9Qt7knKrmA==',key_name='tempest-keypair-1076036811',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-pmywfhxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=da018992-79f4-4db3-bbf7-a492508ff629,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "address": "fa:16:3e:af:e1:6e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9257e17c-00", "ovs_interfaceid": "9257e17c-00d0-4a97-ace5-2d7ce1ba60c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:e1:6e,bridge_name='br-int',has_traffic_filtering=True,id=9257e17c-00d0-4a97-ace5-2d7ce1ba60c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9257e17c-00') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG os_vif [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:e1:6e,bridge_name='br-int',has_traffic_filtering=True,id=9257e17c-00d0-4a97-ace5-2d7ce1ba60c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9257e17c-00') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9257e17c-00, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed3c5d4e-4d64-491b-bbc4-e7122e46336a) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:40:48 user nova-compute[76442]: INFO os_vif [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:e1:6e,bridge_name='br-int',has_traffic_filtering=True,id=9257e17c-00d0-4a97-ace5-2d7ce1ba60c4,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9257e17c-00')
Nov 14 20:40:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Deleting instance files /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629_del
Nov 14 20:40:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Deletion of /opt/stack/data/nova/instances/da018992-79f4-4db3-bbf7-a492508ff629_del complete
Nov 14 20:40:48 user nova-compute[76442]: INFO nova.compute.manager [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 20:40:48 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:40:48 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: da018992-79f4-4db3-bbf7-a492508ff629] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:40:49 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:40:49 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Took 0.82 seconds to deallocate network for instance.
Nov 14 20:40:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-d0a197bd-c15d-42c8-9b65-24a1987c624e req-bf44a93e-5669-4626-a452-5c2c7b9465c6 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received event network-vif-deleted-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxeqNspl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:40:50 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:40:50 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:40:50 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[17355fc7-8844-4573-bf5c-d21b34b38ee6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:40:50 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Deleted allocations for instance da018992-79f4-4db3-bbf7-a492508ff629
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e638eef7-67b9-4d11-bdd8-107aeb11e2bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b] added
Nov 14 20:40:50 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcfb91d-3fe7-424c-81ba-54a3340d4239]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c531861-2520-4bfa-88cf-bf6b68134f5f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxeqNspl {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxeqNspl" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7059c5-3fd9-4dfc-9310-91f8525b30dc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxeqNspl'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a0ca8f74-3c63-40e3-b812-c37656a2836b tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "da018992-79f4-4db3-bbf7-a492508ff629" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1488db29-d3df-4c42-872f-13f2485b07dc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-a26157e3-25e7-46f8-b095-0a6ea5ff125c req-d0d56282-60d9-44eb-99d6-1ce8e14def82 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received event network-vif-plugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a26157e3-25e7-46f8-b095-0a6ea5ff125c req-d0d56282-60d9-44eb-99d6-1ce8e14def82 service nova] Acquiring lock "da018992-79f4-4db3-bbf7-a492508ff629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a26157e3-25e7-46f8-b095-0a6ea5ff125c req-d0d56282-60d9-44eb-99d6-1ce8e14def82 service nova] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a26157e3-25e7-46f8-b095-0a6ea5ff125c req-d0d56282-60d9-44eb-99d6-1ce8e14def82 service nova] Lock "da018992-79f4-4db3-bbf7-a492508ff629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-a26157e3-25e7-46f8-b095-0a6ea5ff125c req-d0d56282-60d9-44eb-99d6-1ce8e14def82 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] No waiting events found dispatching network-vif-plugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:50 user nova-compute[76442]: WARNING nova.compute.manager [req-a26157e3-25e7-46f8-b095-0a6ea5ff125c req-d0d56282-60d9-44eb-99d6-1ce8e14def82 service nova] [instance: da018992-79f4-4db3-bbf7-a492508ff629] Received unexpected event network-vif-plugged-9257e17c-00d0-4a97-ace5-2d7ce1ba60c4 for instance with vm_state deleted and task_state None.
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[407c87f0-f311-4308-8da3-fc72a3f4481b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b36ece-0cca-4c9f-88db-a34bf7669a41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b, portal: 172.16.0.220,3260]
Nov 14 20:40:50 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b, portal: 172.16.0.220,3260] successful.
Nov 14 20:40:50 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[51761e95-aea3-4ab3-ba2d-f1fb146ef61c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6e1acb-fe5e-4529-a151-7d1d8d9fafff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:40:50 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:40:50 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:40:50 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6bc34c-2079-48f4-b628-bf9640afca77]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:40:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxeqNspl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:40:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:40:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23961303738363934', 'path': '/dev/sde'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:40:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961303738363934', 'path': '/dev/sde'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:40:51 user nova-compute[76442]: DEBUG nova.objects.instance [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lazy-loading 'flavor' on Instance uuid a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:40:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:40:51 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:40:51 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:40:51 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:40:51 user nova-compute[76442]:   <serial>80d15607-6f9e-4a9e-97c6-cf990b85439b</serial>
Nov 14 20:40:51 user nova-compute[76442]: </disk>
Nov 14 20:40:51 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:40:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:40:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:40:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] No VIF found with MAC fa:16:3e:54:a3:91, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:40:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-081b2356-339b-43cf-b044-15d49753a151 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.443s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:52 user nova-compute[76442]: INFO nova.compute.manager [None req-4a12cc1e-a64f-401b-999e-b87a15e444e1 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Unrescuing
Nov 14 20:40:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4a12cc1e-a64f-401b-999e-b87a15e444e1 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:40:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4a12cc1e-a64f-401b-999e-b87a15e444e1 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquired lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:40:52 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4a12cc1e-a64f-401b-999e-b87a15e444e1 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:40:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:53 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4a12cc1e-a64f-401b-999e-b87a15e444e1 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating instance_info_cache with network_info: [{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4a12cc1e-a64f-401b-999e-b87a15e444e1 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Releasing lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG nova.objects.instance [None req-4a12cc1e-a64f-401b-999e-b87a15e444e1 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'flavor' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-7806c151-cfe2-4bfa-b839-19ac61997e59 req-3408bbca-d1c7-4a69-840b-145ac10bfcfe service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-unplugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7806c151-cfe2-4bfa-b839-19ac61997e59 req-3408bbca-d1c7-4a69-840b-145ac10bfcfe service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7806c151-cfe2-4bfa-b839-19ac61997e59 req-3408bbca-d1c7-4a69-840b-145ac10bfcfe service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7806c151-cfe2-4bfa-b839-19ac61997e59 req-3408bbca-d1c7-4a69-840b-145ac10bfcfe service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-7806c151-cfe2-4bfa-b839-19ac61997e59 req-3408bbca-d1c7-4a69-840b-145ac10bfcfe service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-unplugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:54 user nova-compute[76442]: WARNING nova.compute.manager [req-7806c151-cfe2-4bfa-b839-19ac61997e59 req-3408bbca-d1c7-4a69-840b-145ac10bfcfe service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-unplugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:40:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Instance destroyed successfully.
Nov 14 20:40:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:55 user nova-compute[76442]: INFO nova.compute.manager [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Detaching volume 94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:40:55 user nova-compute[76442]: INFO nova.virt.block_device [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Attempting to driver detach volume 94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 from mountpoint /dev/vdb
Nov 14 20:40:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Attempting to detach device vdb from instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:40:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:40:55 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:40:55 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:40:55 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:40:55 user nova-compute[76442]:   <serial>94bbbc8a-4c4c-4876-bca5-19a6e3f07d64</serial>
Nov 14 20:40:55 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 20:40:55 user nova-compute[76442]: </disk>
Nov 14 20:40:55 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:40:55 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully detached device vdb from instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 from the persistent domain config.
Nov 14 20:40:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:40:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:40:55 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:40:55 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:40:55 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:40:55 user nova-compute[76442]:   <serial>94bbbc8a-4c4c-4876-bca5-19a6e3f07d64</serial>
Nov 14 20:40:55 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 20:40:55 user nova-compute[76442]: </disk>
Nov 14 20:40:55 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:40:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:40:55 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lazy-loading 'flavor' on Instance uuid a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:40:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:56 user nova-compute[76442]: INFO nova.compute.manager [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Attaching volume 0d9b0e81-8496-418a-8a15-364e40b3a7c0 to /dev/vdc
Nov 14 20:40:56 user nova-compute[76442]: DEBUG os_brick.utils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdf0e6f-5ded-447f-b664-fa21e02492b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f20bf23-4efd-4dfb-8f5b-4d6c5646e0fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c0b11a-669c-409f-b577-0adea9c9a61c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4738ed20-7b6a-44a4-9260-8326ece39a6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:40:56 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed8bae3-78f2-42eb-a7f5-6a2c3ebeb2ae]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG os_brick.utils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Updating existing volume attachment record: 117cd59a-4bad-4733-ab44-b85bb83c1a06 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-changed-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Refreshing instance network info cache due to event network-changed-c58581ff-741a-45f7-a75f-11a6a5ee71ce. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] Acquiring lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] Acquired lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Refreshing network info cache for port c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updated VIF entry in instance network info cache for port c58581ff-741a-45f7-a75f-11a6a5ee71ce. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating instance_info_cache with network_info: [{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] Releasing lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-changed-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Refreshing instance network info cache due to event network-changed-c58581ff-741a-45f7-a75f-11a6a5ee71ce. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] Acquiring lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] Acquired lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Refreshing network info cache for port c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updated VIF entry in instance network info cache for port c58581ff-741a-45f7-a75f-11a6a5ee71ce. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating instance_info_cache with network_info: [{"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] Releasing lock "refresh_cache-3f966f64-95e9-4de8-8464-a7ed018b8db6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:57 user nova-compute[76442]: WARNING nova.compute.manager [req-24be9005-697a-4689-890c-d6b54081ae9b req-5da358da-56b0-48ed-95ee-d2537544032d service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:58 user nova-compute[76442]: WARNING nova.compute.manager [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:40:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:40:58 user nova-compute[76442]: WARNING nova.compute.manager [req-6eb1e858-ebae-4c79-b80c-3933a39a847a req-dddcce49-3ad0-4da6-934e-266a9a3693b6 service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:40:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4a12cc1e-a64f-401b-999e-b87a15e444e1 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:40:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:40:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:40:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 20:41:00 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:41:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:00 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:41:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcVNXGOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:41:01 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:41:01 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:41:01 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b408326b-d847-4759-bb66-2e8f0b6d0285]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:41:01 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4750a49-826a-4984-9dfc-a5f3e56030f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0] added
Nov 14 20:41:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[76826320-75dc-43a2-92a5-700846d5df82]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd7ae6b-8d88-4cd0-9a85-ce0a47ce59a7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcVNXGOw {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcVNXGOw" returned: 0 in 0.029s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffacf5-01f9-4b73-a69b-10d0bc507c1f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcVNXGOw'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3ff562-8eec-49b3-8635-d1998f5e83a2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[764359c1-17fe-40b2-834c-c2514e22ff00]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b850ccb-17ca-4323-97b0-162f8b1660c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0, portal: 172.16.0.220,3260]
Nov 14 20:41:01 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0, portal: 172.16.0.220,3260] successful.
Nov 14 20:41:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c46aaca-4992-4f2f-8309-2c9a8e5d82e6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ced0290-f178-43e4-a8c0-7f3231305bfe]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:01 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] HCTL ('40', '-', '-', 0) found on session 22 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d9c056-d570-4246-b246-82f33b1cdb7f]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Searching for a device in session 22 and hctl ['40', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:41:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Searching for a device in session 22 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcVNXGOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23135653063643461', 'path': '/dev/sdi'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135653063643461', 'path': '/dev/sdi'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lazy-loading 'flavor' on Instance uuid a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:41:02 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:41:02 user nova-compute[76442]:   <source dev="/dev/sdi"/>
Nov 14 20:41:02 user nova-compute[76442]:   <target dev="vdc" bus="virtio"/>
Nov 14 20:41:02 user nova-compute[76442]:   <serial>0d9b0e81-8496-418a-8a15-364e40b3a7c0</serial>
Nov 14 20:41:02 user nova-compute[76442]: </disk>
Nov 14 20:41:02 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] No VIF found with MAC fa:16:3e:54:a3:91, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c038307-16a7-4440-a543-0feb342ed0b4 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.313s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:41:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:04 user nova-compute[76442]: INFO nova.compute.manager [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Detaching volume 0d9b0e81-8496-418a-8a15-364e40b3a7c0
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:04 user nova-compute[76442]: INFO nova.virt.block_device [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Attempting to driver detach volume 0d9b0e81-8496-418a-8a15-364e40b3a7c0 from mountpoint /dev/vdc
Nov 14 20:41:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Attempting to detach device vdc from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:41:04 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:41:04 user nova-compute[76442]:   <source dev="/dev/sdi"/>
Nov 14 20:41:04 user nova-compute[76442]:   <target dev="vdc" bus="virtio"/>
Nov 14 20:41:04 user nova-compute[76442]:   <serial>0d9b0e81-8496-418a-8a15-364e40b3a7c0</serial>
Nov 14 20:41:04 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 20:41:04 user nova-compute[76442]: </disk>
Nov 14 20:41:04 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:41:04 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Successfully detached device vdc from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 from the persistent domain config.
Nov 14 20:41:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:41:04 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:41:04 user nova-compute[76442]:   <source dev="/dev/sdi"/>
Nov 14 20:41:04 user nova-compute[76442]:   <target dev="vdc" bus="virtio"/>
Nov 14 20:41:04 user nova-compute[76442]:   <serial>0d9b0e81-8496-418a-8a15-364e40b3a7c0</serial>
Nov 14 20:41:04 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 20:41:04 user nova-compute[76442]: </disk>
Nov 14 20:41:04 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:04 user nova-compute[76442]: INFO nova.compute.manager [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Terminating instance
Nov 14 20:41:04 user nova-compute[76442]: DEBUG nova.compute.manager [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:41:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e524ece-bdfe-4024-8fc0-340d1aaf8bd7 req-3a9b6e56-5170-4e59-b43a-ef7fa3a8463e service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received event network-vif-unplugged-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e524ece-bdfe-4024-8fc0-340d1aaf8bd7 req-3a9b6e56-5170-4e59-b43a-ef7fa3a8463e service nova] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e524ece-bdfe-4024-8fc0-340d1aaf8bd7 req-3a9b6e56-5170-4e59-b43a-ef7fa3a8463e service nova] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e524ece-bdfe-4024-8fc0-340d1aaf8bd7 req-3a9b6e56-5170-4e59-b43a-ef7fa3a8463e service nova] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e524ece-bdfe-4024-8fc0-340d1aaf8bd7 req-3a9b6e56-5170-4e59-b43a-ef7fa3a8463e service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] No waiting events found dispatching network-vif-unplugged-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e524ece-bdfe-4024-8fc0-340d1aaf8bd7 req-3a9b6e56-5170-4e59-b43a-ef7fa3a8463e service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received event network-vif-unplugged-0b7921ee-3266-4e01-996e-b9f62b1b589a for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:41:05 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:41:05 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7205MB free_disk=25.184974670410156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Instance destroyed successfully.
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.objects.instance [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lazy-loading 'resources' on Instance uuid 24c3abec-1233-45d1-a5ce-d5a14f76b313 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1197385494',display_name='tempest-VolumesAdminNegativeTest-server-1197385494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1197385494',id=6,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlQHpySRIAnXadiOnW4wVNWS/67tXiq06Y9Mb5qaH10uQ7UGVUIteSSLi7+eutxBekv/S+UNrYx3C8FXyBvBHms4e6VZ8rFq0VFHG7ZcfgVZIIboSf7Wra/p33BJbVC4Q==',key_name='tempest-keypair-2112243525',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f754011c54964adcb6898beac89668e1',ramdisk_id='',reservation_id='r-a10fuxk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1803889283',owner_user_name='tempest-VolumesAdminNegativeTest-1803889283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a9c7939d95a4ec1b47672c31de2330a',uuid=24c3abec-1233-45d1-a5ce-d5a14f76b313,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converting VIF {"id": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "address": "fa:16:3e:09:16:af", "network": {"id": "da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-167745787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f754011c54964adcb6898beac89668e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7921ee-32", "ovs_interfaceid": "0b7921ee-3266-4e01-996e-b9f62b1b589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:16:af,bridge_name='br-int',has_traffic_filtering=True,id=0b7921ee-3266-4e01-996e-b9f62b1b589a,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7921ee-32') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG os_vif [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:16:af,bridge_name='br-int',has_traffic_filtering=True,id=0b7921ee-3266-4e01-996e-b9f62b1b589a,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7921ee-32') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b7921ee-32, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74031b22-5611-4fd4-b385-9a62a80197cf) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:05 user nova-compute[76442]: INFO os_vif [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:16:af,bridge_name='br-int',has_traffic_filtering=True,id=0b7921ee-3266-4e01-996e-b9f62b1b589a,network=Network(da8a2ca5-0c4b-476b-b432-7bfc7b0e98ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7921ee-32')
Nov 14 20:41:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Deleting instance files /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313_del
Nov 14 20:41:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Deletion of /opt/stack/data/nova/instances/24c3abec-1233-45d1-a5ce-d5a14f76b313_del complete
Nov 14 20:41:05 user nova-compute[76442]: INFO nova.compute.manager [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 20:41:05 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 24c3abec-1233-45d1-a5ce-d5a14f76b313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a7a0fef1-0074-4b13-8e19-880a1333cc95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 31c7399a-07f6-40d7-a62c-8fa374193ba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance af2fc78b-7d41-4aed-88a2-ebf2952a0af7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 20:41:05 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:06 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Took 0.69 seconds to deallocate network for instance.
Nov 14 20:41:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:06 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Deleted allocations for instance 24c3abec-1233-45d1-a5ce-d5a14f76b313
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-97410594-c950-4da6-ac3d-979fa94523c6 req-5e7e2472-8251-4a91-a735-182e91164b7a service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received event network-vif-plugged-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-97410594-c950-4da6-ac3d-979fa94523c6 req-5e7e2472-8251-4a91-a735-182e91164b7a service nova] Acquiring lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-97410594-c950-4da6-ac3d-979fa94523c6 req-5e7e2472-8251-4a91-a735-182e91164b7a service nova] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-97410594-c950-4da6-ac3d-979fa94523c6 req-5e7e2472-8251-4a91-a735-182e91164b7a service nova] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-97410594-c950-4da6-ac3d-979fa94523c6 req-5e7e2472-8251-4a91-a735-182e91164b7a service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] No waiting events found dispatching network-vif-plugged-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:06 user nova-compute[76442]: WARNING nova.compute.manager [req-97410594-c950-4da6-ac3d-979fa94523c6 req-5e7e2472-8251-4a91-a735-182e91164b7a service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received unexpected event network-vif-plugged-0b7921ee-3266-4e01-996e-b9f62b1b589a for instance with vm_state deleted and task_state None.
Nov 14 20:41:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-97410594-c950-4da6-ac3d-979fa94523c6 req-5e7e2472-8251-4a91-a735-182e91164b7a service nova] [instance: 24c3abec-1233-45d1-a5ce-d5a14f76b313] Received event network-vif-deleted-0b7921ee-3266-4e01-996e-b9f62b1b589a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-294584d4-8c1d-41ec-aa4d-afe94e159469 tempest-VolumesAdminNegativeTest-1803889283 tempest-VolumesAdminNegativeTest-1803889283-project-member] Lock "24c3abec-1233-45d1-a5ce-d5a14f76b313" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_power_states {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid a5970cb5-3f09-43c8-93ac-03053bc2f2cc {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 31c7399a-07f6-40d7-a62c-8fa374193ba0 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid af2fc78b-7d41-4aed-88a2-ebf2952a0af7 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid e62b2506-c519-49bd-a678-0da035a6b1a9 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "31c7399a-07f6-40d7-a62c-8fa374193ba0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "e62b2506-c519-49bd-a678-0da035a6b1a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "ae48904c-9a76-40aa-8566-5cfbeb68a359" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:41:15 user nova-compute[76442]: INFO nova.compute.claims [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Claim successful on node user
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:41:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:41:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Creating image(s)
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "/opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "/opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.policy [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26d34d0a5ada4aaf84176788da8c781c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd05a3b23802440898218c51c6f6eb0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 is timed out.
Nov 14 20:41:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully detached device vdb from instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 from the live domain config.
Nov 14 20:41:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLcysEmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:41:15 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1740928b-d8be-4ddb-90e2-0019472cdfa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:41:15 user nova-compute[76442]: No targets found.
Nov 14 20:41:15 user nova-compute[76442]: iSNS:
Nov 14 20:41:15 user nova-compute[76442]: No targets found.
Nov 14 20:41:15 user nova-compute[76442]: STATIC:
Nov 14 20:41:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0
Nov 14 20:41:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:41:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69
Nov 14 20:41:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b
Nov 14 20:41:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35
Nov 14 20:41:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:41:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc
Nov 14 20:41:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64
Nov 14 20:41:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:15 user nova-compute[76442]: FIRMWARE:
Nov 14 20:41:15 user nova-compute[76442]: No targets found.
Nov 14 20:41:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:41:15 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:41:15 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7144ce5-8589-4c2c-8edd-d8e0ed190586]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697a1a9-ec1b-45c2-8b50-347ed450c658]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:15 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07081cc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:41:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c19827-e6bb-4c0c-8291-4545c900cb12]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-0b29fcef-3f83-4815-b85f-9c52aa580837 req-0bc6c27f-57eb-4ea3-9dd6-9ceb7c2649a8 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-changed-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-0b29fcef-3f83-4815-b85f-9c52aa580837 req-0bc6c27f-57eb-4ea3-9dd6-9ceb7c2649a8 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing instance network info cache due to event network-changed-2e91aa0a-5a60-4adc-9ec7-50814a3918fd. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0b29fcef-3f83-4815-b85f-9c52aa580837 req-0bc6c27f-57eb-4ea3-9dd6-9ceb7c2649a8 service nova] Acquiring lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0b29fcef-3f83-4815-b85f-9c52aa580837 req-0bc6c27f-57eb-4ea3-9dd6-9ceb7c2649a8 service nova] Acquired lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.network.neutron [req-0b29fcef-3f83-4815-b85f-9c52aa580837 req-0bc6c27f-57eb-4ea3-9dd6-9ceb7c2649a8 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Refreshing network info cache for port 2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1083b23-5171-47a7-a597-b702319d218c]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.204s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb956b1-1846-41a5-a0e8-16aa0b905ce1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10feb38-4e97-417a-afa7-2fc5bb75ae6e]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[363f82c1-5738-4f64-aa6c-4d5cdfa7df90]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.201s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7c8269-132a-43f3-857b-ee648072ea2d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260]
Nov 14 20:41:16 user nova-compute[76442]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64, portal: 172.16.0.220,3260] successful.
Nov 14 20:41:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk 1073741824" returned: 0 in 0.050s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94bbbc8a-4c4c-4876-bca5-19a6e3f07d64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7519e5f2-b4bd-4298-ac67-038b703ab219]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== disconnect_volume: return (451ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.190s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Cannot resize image /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Ensure instance console log exists: /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.network.neutron [req-0b29fcef-3f83-4815-b85f-9c52aa580837 req-0bc6c27f-57eb-4ea3-9dd6-9ceb7c2649a8 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updated VIF entry in instance network info cache for port 2e91aa0a-5a60-4adc-9ec7-50814a3918fd. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG nova.network.neutron [req-0b29fcef-3f83-4815-b85f-9c52aa580837 req-0bc6c27f-57eb-4ea3-9dd6-9ceb7c2649a8 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [{"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0b29fcef-3f83-4815-b85f-9c52aa580837 req-0bc6c27f-57eb-4ea3-9dd6-9ceb7c2649a8 service nova] Releasing lock "refresh_cache-af2fc78b-7d41-4aed-88a2-ebf2952a0af7" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Successfully created port: c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Successfully updated port: c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "refresh_cache-ae48904c-9a76-40aa-8566-5cfbeb68a359" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquired lock "refresh_cache-ae48904c-9a76-40aa-8566-5cfbeb68a359" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG nova.objects.instance [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d9510723-9005-424b-b2c6-ca513572962a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.650s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.166s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Updating instance_info_cache with network_info: [{"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Releasing lock "refresh_cache-ae48904c-9a76-40aa-8566-5cfbeb68a359" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Instance network_info: |[{"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Start _get_guest_xml network_info=[{"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:41:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:41:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:41:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-285386602',display_name='tempest-ServersNegativeTestJSON-server-285386602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-285386602',id=21,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d05a3b23802440898218c51c6f6eb0cf',ramdisk_id='',reservation_id='r-f0zu49qx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-145042559',owner_user_name='tempest-ServersNegativeTestJSON-145042559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:41:16Z,user_data=None,user_id='26d34d0a5ada4aaf84176788da8c781c',uuid=ae48904c-9a76-40aa-8566-5cfbeb68a359,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converting VIF {"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1f:c3,bridge_name='br-int',has_traffic_filtering=True,id=c377bc05-dcd0-45b7-9a21-34d36824b1ab,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc377bc05-dc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.objects.instance [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lazy-loading 'pci_devices' on Instance uuid ae48904c-9a76-40aa-8566-5cfbeb68a359 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ecb21df-1713-44f5-864f-c601b76426ee req-e777f085-dca8-4cd2-88b6-8073432c2631 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received event network-changed-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ecb21df-1713-44f5-864f-c601b76426ee req-e777f085-dca8-4cd2-88b6-8073432c2631 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Refreshing instance network info cache due to event network-changed-c377bc05-dcd0-45b7-9a21-34d36824b1ab. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ecb21df-1713-44f5-864f-c601b76426ee req-e777f085-dca8-4cd2-88b6-8073432c2631 service nova] Acquiring lock "refresh_cache-ae48904c-9a76-40aa-8566-5cfbeb68a359" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ecb21df-1713-44f5-864f-c601b76426ee req-e777f085-dca8-4cd2-88b6-8073432c2631 service nova] Acquired lock "refresh_cache-ae48904c-9a76-40aa-8566-5cfbeb68a359" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-6ecb21df-1713-44f5-864f-c601b76426ee req-e777f085-dca8-4cd2-88b6-8073432c2631 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Refreshing network info cache for port c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:41:18 user nova-compute[76442]:   <uuid>ae48904c-9a76-40aa-8566-5cfbeb68a359</uuid>
Nov 14 20:41:18 user nova-compute[76442]:   <name>instance-00000015</name>
Nov 14 20:41:18 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:41:18 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:41:18 user nova-compute[76442]:   <metadata>
Nov 14 20:41:18 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:41:18 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:41:18 user nova-compute[76442]:       <nova:name>tempest-ServersNegativeTestJSON-server-285386602</nova:name>
Nov 14 20:41:18 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:41:18</nova:creationTime>
Nov 14 20:41:18 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:41:18 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:41:18 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:41:18 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:41:18 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:41:18 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:41:18 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:41:18 user nova-compute[76442]:       <nova:owner>
Nov 14 20:41:18 user nova-compute[76442]:         <nova:user uuid="26d34d0a5ada4aaf84176788da8c781c">tempest-ServersNegativeTestJSON-145042559-project-member</nova:user>
Nov 14 20:41:18 user nova-compute[76442]:         <nova:project uuid="d05a3b23802440898218c51c6f6eb0cf">tempest-ServersNegativeTestJSON-145042559</nova:project>
Nov 14 20:41:18 user nova-compute[76442]:       </nova:owner>
Nov 14 20:41:18 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:41:18 user nova-compute[76442]:       <nova:ports>
Nov 14 20:41:18 user nova-compute[76442]:         <nova:port uuid="c377bc05-dcd0-45b7-9a21-34d36824b1ab">
Nov 14 20:41:18 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 20:41:18 user nova-compute[76442]:         </nova:port>
Nov 14 20:41:18 user nova-compute[76442]:       </nova:ports>
Nov 14 20:41:18 user nova-compute[76442]:     </nova:instance>
Nov 14 20:41:18 user nova-compute[76442]:   </metadata>
Nov 14 20:41:18 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:41:18 user nova-compute[76442]:     <system>
Nov 14 20:41:18 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:41:18 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:41:18 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:41:18 user nova-compute[76442]:       <entry name="serial">ae48904c-9a76-40aa-8566-5cfbeb68a359</entry>
Nov 14 20:41:18 user nova-compute[76442]:       <entry name="uuid">ae48904c-9a76-40aa-8566-5cfbeb68a359</entry>
Nov 14 20:41:18 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:41:18 user nova-compute[76442]:     </system>
Nov 14 20:41:18 user nova-compute[76442]:   </sysinfo>
Nov 14 20:41:18 user nova-compute[76442]:   <os>
Nov 14 20:41:18 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:41:18 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:41:18 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:41:18 user nova-compute[76442]:   </os>
Nov 14 20:41:18 user nova-compute[76442]:   <features>
Nov 14 20:41:18 user nova-compute[76442]:     <acpi/>
Nov 14 20:41:18 user nova-compute[76442]:     <apic/>
Nov 14 20:41:18 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:41:18 user nova-compute[76442]:   </features>
Nov 14 20:41:18 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:41:18 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:41:18 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:41:18 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:41:18 user nova-compute[76442]:   </clock>
Nov 14 20:41:18 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:41:18 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:41:18 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:41:18 user nova-compute[76442]:   </cpu>
Nov 14 20:41:18 user nova-compute[76442]:   <devices>
Nov 14 20:41:18 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:41:18 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:41:18 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk"/>
Nov 14 20:41:18 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:41:18 user nova-compute[76442]:     </disk>
Nov 14 20:41:18 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:41:18 user nova-compute[76442]:       <mac address="fa:16:3e:7b:1f:c3"/>
Nov 14 20:41:18 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:41:18 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:41:18 user nova-compute[76442]:       <target dev="tapc377bc05-dc"/>
Nov 14 20:41:18 user nova-compute[76442]:     </interface>
Nov 14 20:41:18 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:41:18 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/console.log" append="off"/>
Nov 14 20:41:18 user nova-compute[76442]:     </serial>
Nov 14 20:41:18 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:41:18 user nova-compute[76442]:     <video>
Nov 14 20:41:18 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:41:18 user nova-compute[76442]:     </video>
Nov 14 20:41:18 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:41:18 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:41:18 user nova-compute[76442]:     </rng>
Nov 14 20:41:18 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:41:18 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:41:18 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:41:18 user nova-compute[76442]:     </memballoon>
Nov 14 20:41:18 user nova-compute[76442]:   </devices>
Nov 14 20:41:18 user nova-compute[76442]: </domain>
Nov 14 20:41:18 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:41:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-285386602',display_name='tempest-ServersNegativeTestJSON-server-285386602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-285386602',id=21,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d05a3b23802440898218c51c6f6eb0cf',ramdisk_id='',reservation_id='r-f0zu49qx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-145042559',owner_user_name='tempest-ServersNegativeTestJSON-145042559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:41:16Z,user_data=None,user_id='26d34d0a5ada4aaf84176788da8c781c',uuid=ae48904c-9a76-40aa-8566-5cfbeb68a359,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converting VIF {"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1f:c3,bridge_name='br-int',has_traffic_filtering=True,id=c377bc05-dcd0-45b7-9a21-34d36824b1ab,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc377bc05-dc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG os_vif [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1f:c3,bridge_name='br-int',has_traffic_filtering=True,id=c377bc05-dcd0-45b7-9a21-34d36824b1ab,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc377bc05-dc') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ab64671-13e7-5b26-b97c-9e47c724c9cd', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc377bc05-dc, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc377bc05-dc, col_values=(('qos', UUID('5b93e792-e83c-4d50-bdbd-5ced51170986')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc377bc05-dc, col_values=(('external_ids', {'iface-id': 'c377bc05-dcd0-45b7-9a21-34d36824b1ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:1f:c3', 'vm-uuid': 'ae48904c-9a76-40aa-8566-5cfbeb68a359'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: INFO os_vif [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1f:c3,bridge_name='br-int',has_traffic_filtering=True,id=c377bc05-dcd0-45b7-9a21-34d36824b1ab,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc377bc05-dc')
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] No VIF found with MAC fa:16:3e:7b:1f:c3, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-6ecb21df-1713-44f5-864f-c601b76426ee req-e777f085-dca8-4cd2-88b6-8073432c2631 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Updated VIF entry in instance network info cache for port c377bc05-dcd0-45b7-9a21-34d36824b1ab. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-6ecb21df-1713-44f5-864f-c601b76426ee req-e777f085-dca8-4cd2-88b6-8073432c2631 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Updating instance_info_cache with network_info: [{"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ecb21df-1713-44f5-864f-c601b76426ee req-e777f085-dca8-4cd2-88b6-8073432c2631 service nova] Releasing lock "refresh_cache-ae48904c-9a76-40aa-8566-5cfbeb68a359" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:18 user nova-compute[76442]: INFO nova.compute.manager [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Terminating instance
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dec9fccc-f4fd-4f8b-91f0-509b9e698bd8 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dec9fccc-f4fd-4f8b-91f0-509b9e698bd8 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dec9fccc-f4fd-4f8b-91f0-509b9e698bd8 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dec9fccc-f4fd-4f8b-91f0-509b9e698bd8 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76442) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG nova.objects.instance [None req-dec9fccc-f4fd-4f8b-91f0-509b9e698bd8 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-61461f79-3e49-4edd-b841-207fa0f6af6c req-926b0c17-57fa-47b4-8c50-616ff139374e service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-61461f79-3e49-4edd-b841-207fa0f6af6c req-926b0c17-57fa-47b4-8c50-616ff139374e service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-61461f79-3e49-4edd-b841-207fa0f6af6c req-926b0c17-57fa-47b4-8c50-616ff139374e service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-61461f79-3e49-4edd-b841-207fa0f6af6c req-926b0c17-57fa-47b4-8c50-616ff139374e service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-61461f79-3e49-4edd-b841-207fa0f6af6c req-926b0c17-57fa-47b4-8c50-616ff139374e service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-unplugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-61461f79-3e49-4edd-b841-207fa0f6af6c req-926b0c17-57fa-47b4-8c50-616ff139374e service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-4db84a14-ab68-4532-af4f-4dc20e38c571 req-5e0be1b4-dedb-4f7d-bee4-86c74357948c service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4db84a14-ab68-4532-af4f-4dc20e38c571 req-5e0be1b4-dedb-4f7d-bee4-86c74357948c service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4db84a14-ab68-4532-af4f-4dc20e38c571 req-5e0be1b4-dedb-4f7d-bee4-86c74357948c service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4db84a14-ab68-4532-af4f-4dc20e38c571 req-5e0be1b4-dedb-4f7d-bee4-86c74357948c service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-4db84a14-ab68-4532-af4f-4dc20e38c571 req-5e0be1b4-dedb-4f7d-bee4-86c74357948c service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-unplugged-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-4db84a14-ab68-4532-af4f-4dc20e38c571 req-5e0be1b4-dedb-4f7d-bee4-86c74357948c service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-ec963ded-b534-4f97-b8df-4257671d2fe9 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-unplugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:20 user nova-compute[76442]: WARNING nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-8fb1678c-0972-4bbe-98a4-67677ac6e2d2 for instance with vm_state active and task_state deleting.
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-unplugged-8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-8c570d93-b917-4c24-a002-876b00044b1c for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-8c570d93-b917-4c24-a002-876b00044b1c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:20 user nova-compute[76442]: WARNING nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-8c570d93-b917-4c24-a002-876b00044b1c for instance with vm_state active and task_state deleting.
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-unplugged-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-58039e0b-d475-4bd9-9c73-a4a2d3abb8b1 req-7892ca1e-68da-4552-91ea-e569d295057d service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-c1f45401-6091-40a4-b051-84ebfd71b966 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:41:20 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance destroyed successfully.
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dec9fccc-f4fd-4f8b-91f0-509b9e698bd8 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dec9fccc-f4fd-4f8b-91f0-509b9e698bd8 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.528s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Instance destroyed successfully.
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lazy-loading 'resources' on Instance uuid af2fc78b-7d41-4aed-88a2-ebf2952a0af7 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:42:93,bridge_name='br-int',has_traffic_filtering=True,id=2e91aa0a-5a60-4adc-9ec7-50814a3918fd,network=Network(81ba528b-1bbc-4964-8dfb-439b434d0c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e91aa0a-5a') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:42:93,bridge_name='br-int',has_traffic_filtering=True,id=2e91aa0a-5a60-4adc-9ec7-50814a3918fd,network=Network(81ba528b-1bbc-4964-8dfb-439b434d0c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e91aa0a-5a') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e91aa0a-5a, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bff0bbea-9520-49c9-bf44-13e17fd9b44f) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: INFO os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:42:93,bridge_name='br-int',has_traffic_filtering=True,id=2e91aa0a-5a60-4adc-9ec7-50814a3918fd,network=Network(81ba528b-1bbc-4964-8dfb-439b434d0c8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e91aa0a-5a')
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:72:c2,bridge_name='br-int',has_traffic_filtering=True,id=8fb1678c-0972-4bbe-98a4-67677ac6e2d2,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fb1678c-09') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:72:c2,bridge_name='br-int',has_traffic_filtering=True,id=8fb1678c-0972-4bbe-98a4-67677ac6e2d2,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fb1678c-09') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fb1678c-09, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d10c382f-55e6-43cb-bfee-078a8ab16815) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:21 user nova-compute[76442]: WARNING nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-2e91aa0a-5a60-4adc-9ec7-50814a3918fd for instance with vm_state active and task_state deleting.
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-unplugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-unplugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:21 user nova-compute[76442]: WARNING nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-unplugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state stopped and task_state None.
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:21 user nova-compute[76442]: WARNING nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state stopped and task_state None.
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-unplugged-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-450fa94f-63d9-46f5-a4e8-69af6585df23 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:21 user nova-compute[76442]: WARNING nova.compute.manager [req-9c57758b-563e-45e5-89ec-1d01d139da97 req-6b7474a6-82f1-445c-82f2-f833cdf538fa service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-450fa94f-63d9-46f5-a4e8-69af6585df23 for instance with vm_state active and task_state deleting.
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: INFO os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:72:c2,bridge_name='br-int',has_traffic_filtering=True,id=8fb1678c-0972-4bbe-98a4-67677ac6e2d2,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fb1678c-09')
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:18:bd,bridge_name='br-int',has_traffic_filtering=True,id=8c570d93-b917-4c24-a002-876b00044b1c,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c570d93-b9') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:18:bd,bridge_name='br-int',has_traffic_filtering=True,id=8c570d93-b917-4c24-a002-876b00044b1c,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c570d93-b9') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c570d93-b9, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=642f06e2-5ede-453e-831c-a58d3ba36db1) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: INFO os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:18:bd,bridge_name='br-int',has_traffic_filtering=True,id=8c570d93-b917-4c24-a002-876b00044b1c,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c570d93-b9')
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=c1f45401-6091-40a4-b051-84ebfd71b966,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f45401-60') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=c1f45401-6091-40a4-b051-84ebfd71b966,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f45401-60') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1f45401-60, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6581419d-5d41-41f0-9bcc-ecaa53afe254) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: INFO os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=c1f45401-6091-40a4-b051-84ebfd71b966,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f45401-60')
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "450fa94f-63d9-46f5-a4e8-69af6585df23", "address": "fa:16:3e:f4:90:2a", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450fa94f-63", "ovs_interfaceid": "450fa94f-63d9-46f5-a4e8-69af6585df23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:90:2a,bridge_name='br-int',has_traffic_filtering=True,id=450fa94f-63d9-46f5-a4e8-69af6585df23,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450fa94f-63') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:90:2a,bridge_name='br-int',has_traffic_filtering=True,id=450fa94f-63d9-46f5-a4e8-69af6585df23,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450fa94f-63') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap450fa94f-63, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bd11186-eed7-4154-95db-7b1da2cc8c61) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: INFO os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:90:2a,bridge_name='br-int',has_traffic_filtering=True,id=450fa94f-63d9-46f5-a4e8-69af6585df23,network=Network(09770108-b4cc-4c86-808f-c948a315cfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450fa94f-63')
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:23:83,bridge_name='br-int',has_traffic_filtering=True,id=93a5bd0e-57a0-4a08-811c-dc9a12a06e54,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a5bd0e-57') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:23:83,bridge_name='br-int',has_traffic_filtering=True,id=93a5bd0e-57a0-4a08-811c-dc9a12a06e54,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a5bd0e-57') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93a5bd0e-57, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05c2bba1-fdc5-42ef-8f97-b21d2611cb59) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: INFO os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:23:83,bridge_name='br-int',has_traffic_filtering=True,id=93a5bd0e-57a0-4a08-811c-dc9a12a06e54,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93a5bd0e-57')
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-113320294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-113320294',id=17,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXLnYi6yq+VEmCsXV11SWBcg2XTBAm6ptmmvGYmJKkYBjd3hjj3jABg6YxZhFfTdatnRG6sR+3n1GwFzTJAIMb6JlYs6jvFucRKLbDzsZOhdUhhgZUlXLZqUc1S7xOm2g==',key_name='tempest-keypair-1696751069',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2e62fa5383e4a83aff08bfd6ac92f1a',ramdisk_id='',reservation_id='r-2409m37a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-542333708',owner_user_name='tempest-TaggedBootDevicesTest-542333708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d6015fa259d4659afce1794a9e3de38',uuid=af2fc78b-7d41-4aed-88a2-ebf2952a0af7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converting VIF {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:06,bridge_name='br-int',has_traffic_filtering=True,id=ec963ded-b534-4f97-b8df-4257671d2fe9,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec963ded-b5') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:06,bridge_name='br-int',has_traffic_filtering=True,id=ec963ded-b534-4f97-b8df-4257671d2fe9,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec963ded-b5') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec963ded-b5, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14e65644-74d1-4662-87d7-aeba0a924774) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:21 user nova-compute[76442]: INFO os_vif [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:06,bridge_name='br-int',has_traffic_filtering=True,id=ec963ded-b534-4f97-b8df-4257671d2fe9,network=Network(746321a3-8aeb-46a3-8d96-836eb3769d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec963ded-b5')
Nov 14 20:41:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:41:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwuBTFCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:41:22 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0ad998-6970-4235-ae38-877f3948e776]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:41:22 user nova-compute[76442]: No targets found.
Nov 14 20:41:22 user nova-compute[76442]: iSNS:
Nov 14 20:41:22 user nova-compute[76442]: No targets found.
Nov 14 20:41:22 user nova-compute[76442]: STATIC:
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: FIRMWARE:
Nov 14 20:41:22 user nova-compute[76442]: No targets found.
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:41:22 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:41:22 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f39b9e-1426-4bb1-bfaa-416f866fa830]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46aa1e6-97fb-48cf-8660-7059240dc138]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e873a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc'): ({'sdf'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Removing single pathed devices sdf {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.062s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc800b-b1c4-4f6f-99ec-3563d6c924fb]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94503dc-22eb-493c-b4ee-cfb15877987a]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Flushing IO for device /dev/sdf {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[af85d122-c44b-4301-8d21-7ce18a713afb]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-3ede4c73-970e-4240-814e-14b62006c336 req-e74760f9-ab40-4d78-8c5d-e8bd98c3e930 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3ede4c73-970e-4240-814e-14b62006c336 req-e74760f9-ab40-4d78-8c5d-e8bd98c3e930 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3ede4c73-970e-4240-814e-14b62006c336 req-e74760f9-ab40-4d78-8c5d-e8bd98c3e930 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3ede4c73-970e-4240-814e-14b62006c336 req-e74760f9-ab40-4d78-8c5d-e8bd98c3e930 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-3ede4c73-970e-4240-814e-14b62006c336 req-e74760f9-ab40-4d78-8c5d-e8bd98c3e930 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:22 user nova-compute[76442]: WARNING nova.compute.manager [req-3ede4c73-970e-4240-814e-14b62006c336 req-e74760f9-ab40-4d78-8c5d-e8bd98c3e930 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-ec963ded-b534-4f97-b8df-4257671d2fe9 for instance with vm_state active and task_state deleting.
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed1d643-e934-4fd3-958a-bc8efc9c5978]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c76f73-0c3e-4413-9b2e-ee0164b33c95]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da44cf2-32de-4956-893e-f004caaf0413]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc, portal: 172.16.0.220,3260]
Nov 14 20:41:22 user nova-compute[76442]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc, portal: 172.16.0.220,3260] successful.
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffd9b893-a2d4-4b22-b7d7-857f130c05fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4046850-07b5-4e91-a18b-97db5f84c98a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] <== disconnect_volume: return (452ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLRyuoQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:41:22 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cdea99-fc40-4630-bfa5-b84faed1e2c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:41:22 user nova-compute[76442]: No targets found.
Nov 14 20:41:22 user nova-compute[76442]: iSNS:
Nov 14 20:41:22 user nova-compute[76442]: No targets found.
Nov 14 20:41:22 user nova-compute[76442]: STATIC:
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: FIRMWARE:
Nov 14 20:41:22 user nova-compute[76442]: No targets found.
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:41:22 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:41:22 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a51a53b-1c9b-465f-b0bb-f092983aca45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e619d27d-af33-4236-aa11-31a2fa742278]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4fecca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69'): ({'sdg'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Removing single pathed devices sdg {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0be6689-6195-4578-8c47-97c16443c62d]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:22 user nova-compute[76442]: WARNING nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-c1f45401-6091-40a4-b051-84ebfd71b966 for instance with vm_state active and task_state deleting.
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-unplugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-unplugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-plugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Acquiring lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] No waiting events found dispatching network-vif-plugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:22 user nova-compute[76442]: WARNING nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received unexpected event network-vif-plugged-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 for instance with vm_state active and task_state deleting.
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received event network-vif-plugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Acquiring lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] No waiting events found dispatching network-vif-plugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:22 user nova-compute[76442]: WARNING nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received unexpected event network-vif-plugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab for instance with vm_state building and task_state spawning.
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received event network-vif-plugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Acquiring lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] No waiting events found dispatching network-vif-plugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:22 user nova-compute[76442]: WARNING nova.compute.manager [req-441a0e94-6706-4469-afe3-e6336bd06d69 req-4e439e93-88cf-475f-b0f7-3b84b919e2c5 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received unexpected event network-vif-plugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab for instance with vm_state building and task_state spawning.
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06d7c11-2476-4fe4-acc1-f96e7d0b4e19]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Flushing IO for device /dev/sdg {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec44dc-bb5a-43bd-9e84-8c1e140d5b28]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.065s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e33077-37f0-4cc6-aff5-a9273e01ed78]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] SCSI volumes sdg have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b981b8-19cc-49e9-8350-f78ae3d63730]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4b8af0-a083-45e7-b3c8-99b34c21fc8e]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69, portal: 172.16.0.220,3260]
Nov 14 20:41:22 user nova-compute[76442]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69, portal: 172.16.0.220,3260] successful.
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed4e0d4f-43b8-4d2e-b421-d62acd8e5d69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba506ed-b1f5-458c-943a-4fdc7cc77bb6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] <== disconnect_volume: return (366ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYzBlZkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:41:22 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e059ffb-54fc-4539-b375-7fa6874b8d7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:41:22 user nova-compute[76442]: No targets found.
Nov 14 20:41:22 user nova-compute[76442]: iSNS:
Nov 14 20:41:22 user nova-compute[76442]: No targets found.
Nov 14 20:41:22 user nova-compute[76442]: STATIC:
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:41:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:22 user nova-compute[76442]: FIRMWARE:
Nov 14 20:41:22 user nova-compute[76442]: No targets found.
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:41:22 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:41:22 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[52628084-3b9b-4c98-9267-3bf5c18c5c76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[434970bc-9111-438e-bde5-41ff4c0547de]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:22 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e85e4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35'): ({'sdh'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Removing single pathed devices sdh {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d5487d-38e3-4865-8ce6-4750d466c82d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6bc0de-f87c-4078-a98e-401c2ae0babe]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Flushing IO for device /dev/sdh {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d8c204-6ec5-48f8-863b-552491bba429]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[182e3d1b-ffa7-4a6e-aaeb-08cd3b09549c]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] SCSI volumes sdh have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:41:22 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Instance spawned successfully.
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac2593f-8c1f-4adb-a9a8-1332c8863ac0]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a322a2d3-abdb-4100-ba12-1ccaffc5ca2c]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35, portal: 172.16.0.220,3260]
Nov 14 20:41:22 user nova-compute[76442]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35, portal: 172.16.0.220,3260] successful.
Nov 14 20:41:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692a6d7e-d181-4b0b-9f67-019aab85ef35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f7561b-3a50-403a-8ecb-fff44a156a08]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] <== disconnect_volume: return (302ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:41:22 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Deleting instance files /opt/stack/data/nova/instances/af2fc78b-7d41-4aed-88a2-ebf2952a0af7_del
Nov 14 20:41:22 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Deletion of /opt/stack/data/nova/instances/af2fc78b-7d41-4aed-88a2-ebf2952a0af7_del complete
Nov 14 20:41:22 user nova-compute[76442]: INFO nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Took 6.96 seconds to spawn the instance on the hypervisor.
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:41:22 user nova-compute[76442]: INFO nova.compute.manager [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Took 4.23 seconds to destroy the instance on the hypervisor.
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:41:22 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:41:22 user nova-compute[76442]: INFO nova.compute.manager [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Took 7.77 seconds to build instance.
Nov 14 20:41:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-35208891-6506-4f1d-86ab-4ce4b6a64679 tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.874s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-00ee3a4a-d9f3-4b6a-b804-1568fdfd0b83 req-959fe2c2-19ca-4edf-862e-4810aaf4f3ee service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-deleted-450fa94f-63d9-46f5-a4e8-69af6585df23 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:24 user nova-compute[76442]: INFO nova.compute.manager [req-00ee3a4a-d9f3-4b6a-b804-1568fdfd0b83 req-959fe2c2-19ca-4edf-862e-4810aaf4f3ee service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Neutron deleted interface 450fa94f-63d9-46f5-a4e8-69af6585df23; detaching it from the instance and deleting it from the info cache
Nov 14 20:41:24 user nova-compute[76442]: DEBUG nova.network.neutron [req-00ee3a4a-d9f3-4b6a-b804-1568fdfd0b83 req-959fe2c2-19ca-4edf-862e-4810aaf4f3ee service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [{"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "address": "fa:16:3e:55:23:83", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93a5bd0e-57", "ovs_interfaceid": "93a5bd0e-57a0-4a08-811c-dc9a12a06e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-00ee3a4a-d9f3-4b6a-b804-1568fdfd0b83 req-959fe2c2-19ca-4edf-862e-4810aaf4f3ee service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Detach interface failed, port_id=450fa94f-63d9-46f5-a4e8-69af6585df23, reason: Instance af2fc78b-7d41-4aed-88a2-ebf2952a0af7 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:41:25 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 is timed out.
Nov 14 20:41:25 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Successfully detached device vdc from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 from the live domain config.
Nov 14 20:41:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcVNXGOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:41:25 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbe25ba-e56f-4707-b7e3-3a5f3d961c12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:41:25 user nova-compute[76442]: No targets found.
Nov 14 20:41:25 user nova-compute[76442]: iSNS:
Nov 14 20:41:25 user nova-compute[76442]: No targets found.
Nov 14 20:41:25 user nova-compute[76442]: STATIC:
Nov 14 20:41:25 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0
Nov 14 20:41:25 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:25 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:25 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:41:25 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:25 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:25 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b
Nov 14 20:41:25 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:25 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:25 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:41:25 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:25 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:25 user nova-compute[76442]: FIRMWARE:
Nov 14 20:41:25 user nova-compute[76442]: No targets found.
Nov 14 20:41:25 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:41:25 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:41:25 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4720bdd0-5786-4f87-81f7-87cd89975bf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2473643-2ccd-4aa0-a6c1-24f74645b757]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:25 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:25 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:25 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:25 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:25 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:25 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:25 user nova-compute[76442]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 (non-flash)
Nov 14 20:41:25 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4e6fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0'): ({'sdi'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Removing single pathed devices sdi {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc346bd-b12b-4576-8569-c5a66057e71e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ad792e-b494-4897-b5b8-3c8e46788e06]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Flushing IO for device /dev/sdi {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d8dec-e0a5-454f-b7ff-71efc7355f94]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e628c4db-3395-441f-b262-ce20f4d03507]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] SCSI volumes sdi have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[572fc49f-2694-4c9c-8ae7-8fa88ed1489a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeafc8b3-c099-442d-a9fc-eeb1eca6491a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0, portal: 172.16.0.220,3260]
Nov 14 20:41:25 user nova-compute[76442]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0, portal: 172.16.0.220,3260] successful.
Nov 14 20:41:25 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9b0e81-8496-418a-8a15-364e40b3a7c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f782d9-61ec-4de4-9b62-580843f1d68e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] <== disconnect_volume: return (370ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:41:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:26 user nova-compute[76442]: INFO nova.compute.manager [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Detaching volume ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:41:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:26 user nova-compute[76442]: INFO nova.virt.block_device [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Attempting to driver detach volume ff97a4a3-4c08-4e92-a262-79805755fce7 from mountpoint /dev/vdb
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Attempting to detach device vdb from instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:41:26 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:41:26 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 20:41:26 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:41:26 user nova-compute[76442]:   <serial>ff97a4a3-4c08-4e92-a262-79805755fce7</serial>
Nov 14 20:41:26 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:41:26 user nova-compute[76442]: </disk>
Nov 14 20:41:26 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:41:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Successfully detached device vdb from instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 from the persistent domain config.
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:41:26 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:41:26 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 20:41:26 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:41:26 user nova-compute[76442]:   <serial>ff97a4a3-4c08-4e92-a262-79805755fce7</serial>
Nov 14 20:41:26 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:41:26 user nova-compute[76442]: </disk>
Nov 14 20:41:26 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-deleted-93a5bd0e-57a0-4a08-811c-dc9a12a06e54 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:26 user nova-compute[76442]: INFO nova.compute.manager [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Neutron deleted interface 93a5bd0e-57a0-4a08-811c-dc9a12a06e54; detaching it from the instance and deleting it from the info cache
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.network.neutron [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [{"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec963ded-b534-4f97-b8df-4257671d2fe9", "address": "fa:16:3e:0e:74:06", "network": {"id": "746321a3-8aeb-46a3-8d96-836eb3769d7a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1546068158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec963ded-b5", "ovs_interfaceid": "ec963ded-b534-4f97-b8df-4257671d2fe9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Detach interface failed, port_id=93a5bd0e-57a0-4a08-811c-dc9a12a06e54, reason: Instance af2fc78b-7d41-4aed-88a2-ebf2952a0af7 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-deleted-ec963ded-b534-4f97-b8df-4257671d2fe9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:26 user nova-compute[76442]: INFO nova.compute.manager [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Neutron deleted interface ec963ded-b534-4f97-b8df-4257671d2fe9; detaching it from the instance and deleting it from the info cache
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.network.neutron [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [{"id": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "address": "fa:16:3e:3b:42:93", "network": {"id": "81ba528b-1bbc-4964-8dfb-439b434d0c8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1005997954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e91aa0a-5a", "ovs_interfaceid": "2e91aa0a-5a60-4adc-9ec7-50814a3918fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Detach interface failed, port_id=ec963ded-b534-4f97-b8df-4257671d2fe9, reason: Instance af2fc78b-7d41-4aed-88a2-ebf2952a0af7 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-deleted-2e91aa0a-5a60-4adc-9ec7-50814a3918fd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:26 user nova-compute[76442]: INFO nova.compute.manager [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Neutron deleted interface 2e91aa0a-5a60-4adc-9ec7-50814a3918fd; detaching it from the instance and deleting it from the info cache
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.network.neutron [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [{"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c1f45401-6091-40a4-b051-84ebfd71b966", "address": "fa:16:3e:2e:ee:b0", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f45401-60", "ovs_interfaceid": "c1f45401-6091-40a4-b051-84ebfd71b966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:26 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Took 4.05 seconds to deallocate network for instance.
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-aac07ea0-1d4e-457f-a677-7f7515ded21d req-0d2225a2-b810-4e15-aa19-24d608c507a2 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Detach interface failed, port_id=2e91aa0a-5a60-4adc-9ec7-50814a3918fd, reason: Instance af2fc78b-7d41-4aed-88a2-ebf2952a0af7 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG nova.objects.instance [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lazy-loading 'flavor' on Instance uuid a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c86b9d25-9887-4963-b299-1321c2a07787 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.757s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.396s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:41:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-c88c95e8-20dd-4d7f-9f84-5412c587cf0d req-f1472104-8622-4ee0-8e9b-3e9614146543 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Received event network-vif-deleted-c1f45401-6091-40a4-b051-84ebfd71b966 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:28 user nova-compute[76442]: INFO nova.compute.manager [req-c88c95e8-20dd-4d7f-9f84-5412c587cf0d req-f1472104-8622-4ee0-8e9b-3e9614146543 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Neutron deleted interface c1f45401-6091-40a4-b051-84ebfd71b966; detaching it from the instance and deleting it from the info cache
Nov 14 20:41:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-c88c95e8-20dd-4d7f-9f84-5412c587cf0d req-f1472104-8622-4ee0-8e9b-3e9614146543 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Updating instance_info_cache with network_info: [{"id": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "address": "fa:16:3e:c5:72:c2", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb1678c-09", "ovs_interfaceid": "8fb1678c-0972-4bbe-98a4-67677ac6e2d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c570d93-b917-4c24-a002-876b00044b1c", "address": "fa:16:3e:97:18:bd", "network": {"id": "09770108-b4cc-4c86-808f-c948a315cfe4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1540561605", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c2e62fa5383e4a83aff08bfd6ac92f1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c570d93-b9", "ovs_interfaceid": "8c570d93-b917-4c24-a002-876b00044b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-c88c95e8-20dd-4d7f-9f84-5412c587cf0d req-f1472104-8622-4ee0-8e9b-3e9614146543 service nova] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Detach interface failed, port_id=c1f45401-6091-40a4-b051-84ebfd71b966, reason: Instance af2fc78b-7d41-4aed-88a2-ebf2952a0af7 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:41:29 user nova-compute[76442]: INFO nova.compute.manager [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] [instance: af2fc78b-7d41-4aed-88a2-ebf2952a0af7] Took 2.30 seconds to detach 3 volumes for instance.
Nov 14 20:41:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:29 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:41:29 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:41:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:29 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Deleted allocations for instance af2fc78b-7d41-4aed-88a2-ebf2952a0af7
Nov 14 20:41:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a47ee0c4-bfa4-4cd7-855a-a21ed6fade5c tempest-TaggedBootDevicesTest-542333708 tempest-TaggedBootDevicesTest-542333708-project-member] Lock "af2fc78b-7d41-4aed-88a2-ebf2952a0af7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.138s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:33 user nova-compute[76442]: INFO nova.compute.manager [None req-91f211f6-4074-49d2-82f5-8a2206e62ff1 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Unrescuing
Nov 14 20:41:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91f211f6-4074-49d2-82f5-8a2206e62ff1 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:41:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91f211f6-4074-49d2-82f5-8a2206e62ff1 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquired lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:41:33 user nova-compute[76442]: DEBUG nova.network.neutron [None req-91f211f6-4074-49d2-82f5-8a2206e62ff1 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-91f211f6-4074-49d2-82f5-8a2206e62ff1 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updating instance_info_cache with network_info: [{"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91f211f6-4074-49d2-82f5-8a2206e62ff1 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Releasing lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG nova.objects.instance [None req-91f211f6-4074-49d2-82f5-8a2206e62ff1 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'flavor' on Instance uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-f9c566cb-3118-4632-ab1f-2ba970193144 req-5c013be3-c81d-4030-9daa-ad9850be381a service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-unplugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f9c566cb-3118-4632-ab1f-2ba970193144 req-5c013be3-c81d-4030-9daa-ad9850be381a service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f9c566cb-3118-4632-ab1f-2ba970193144 req-5c013be3-c81d-4030-9daa-ad9850be381a service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f9c566cb-3118-4632-ab1f-2ba970193144 req-5c013be3-c81d-4030-9daa-ad9850be381a service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-f9c566cb-3118-4632-ab1f-2ba970193144 req-5c013be3-c81d-4030-9daa-ad9850be381a service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-unplugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:34 user nova-compute[76442]: WARNING nova.compute.manager [req-f9c566cb-3118-4632-ab1f-2ba970193144 req-5c013be3-c81d-4030-9daa-ad9850be381a service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-unplugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:41:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Instance destroyed successfully.
Nov 14 20:41:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-9d74f8cf-97a6-47d1-88b5-daf3c150bd8d req-3d6949eb-bf6c-4954-a4ed-de124c75b230 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9d74f8cf-97a6-47d1-88b5-daf3c150bd8d req-3d6949eb-bf6c-4954-a4ed-de124c75b230 service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9d74f8cf-97a6-47d1-88b5-daf3c150bd8d req-3d6949eb-bf6c-4954-a4ed-de124c75b230 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9d74f8cf-97a6-47d1-88b5-daf3c150bd8d req-3d6949eb-bf6c-4954-a4ed-de124c75b230 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-9d74f8cf-97a6-47d1-88b5-daf3c150bd8d req-3d6949eb-bf6c-4954-a4ed-de124c75b230 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:36 user nova-compute[76442]: WARNING nova.compute.manager [req-9d74f8cf-97a6-47d1-88b5-daf3c150bd8d req-3d6949eb-bf6c-4954-a4ed-de124c75b230 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:41:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:38 user nova-compute[76442]: INFO nova.compute.manager [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Rescuing
Nov 14 20:41:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquired lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91f211f6-4074-49d2-82f5-8a2206e62ff1 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:38 user nova-compute[76442]: WARNING nova.compute.manager [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state active and task_state None.
Nov 14 20:41:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:38 user nova-compute[76442]: WARNING nova.compute.manager [req-8177bc97-5eaf-486a-972a-476fc8bc60d5 req-c62376d0-3486-4b82-87f9-b30e894b133d service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state active and task_state None.
Nov 14 20:41:39 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Updating instance_info_cache with network_info: [{"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Releasing lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:41:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-675ec8d1-4437-4f35-9c57-ddb21dd91f07 req-a6ddb565-7558-4978-a33a-90c5902d60fd service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-unplugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-675ec8d1-4437-4f35-9c57-ddb21dd91f07 req-a6ddb565-7558-4978-a33a-90c5902d60fd service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-675ec8d1-4437-4f35-9c57-ddb21dd91f07 req-a6ddb565-7558-4978-a33a-90c5902d60fd service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-675ec8d1-4437-4f35-9c57-ddb21dd91f07 req-a6ddb565-7558-4978-a33a-90c5902d60fd service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-675ec8d1-4437-4f35-9c57-ddb21dd91f07 req-a6ddb565-7558-4978-a33a-90c5902d60fd service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-unplugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:39 user nova-compute[76442]: WARNING nova.compute.manager [req-675ec8d1-4437-4f35-9c57-ddb21dd91f07 req-a6ddb565-7558-4978-a33a-90c5902d60fd service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-unplugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state active and task_state rescuing.
Nov 14 20:41:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:40 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Instance destroyed successfully.
Nov 14 20:41:40 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Attempting rescue
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76442) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Instance directory exists: not creating {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 20:41:40 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Creating image(s)
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue" returned: 0 in 0.047s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'migration_context' on Instance uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.base [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<f9200286-76da-4cc2-8592-c46cfbd5e83e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Start _get_guest_xml network_info=[{"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "vif_mac": "fa:16:3e:f4:af:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'resources' on Instance uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.base [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<f9200286-76da-4cc2-8592-c46cfbd5e83e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'numa_topology' on Instance uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.base [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<f9200286-76da-4cc2-8592-c46cfbd5e83e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:41:40 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:41:40 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.base [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<f9200286-76da-4cc2-8592-c46cfbd5e83e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1584248445',display_name='tempest-ServerRescueNegativeTestJSON-server-1584248445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1584248445',id=19,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:40:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-oqv0u6ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:40:00Z,user_data=None,user_id='5d5a850b0e6c48359f78aa669b038897',uuid=f9200286-76da-4cc2-8592-c46cfbd5e83e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "vif_mac": "fa:16:3e:f4:af:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "vif_mac": "fa:16:3e:f4:af:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=54c7f1f0-36f9-40ec-9349-81a3a62afe53,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c7f1f0-36') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'pci_devices' on Instance uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.objects.base [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<f9200286-76da-4cc2-8592-c46cfbd5e83e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:41:40 user nova-compute[76442]:   <uuid>f9200286-76da-4cc2-8592-c46cfbd5e83e</uuid>
Nov 14 20:41:40 user nova-compute[76442]:   <name>instance-00000013</name>
Nov 14 20:41:40 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:41:40 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:41:40 user nova-compute[76442]:   <metadata>
Nov 14 20:41:40 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:41:40 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:41:40 user nova-compute[76442]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1584248445</nova:name>
Nov 14 20:41:40 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:41:40</nova:creationTime>
Nov 14 20:41:40 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:41:40 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:41:40 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:41:40 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:41:40 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:41:40 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:41:40 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:41:40 user nova-compute[76442]:       <nova:owner>
Nov 14 20:41:40 user nova-compute[76442]:         <nova:user uuid="5d5a850b0e6c48359f78aa669b038897">tempest-ServerRescueNegativeTestJSON-916964129-project-member</nova:user>
Nov 14 20:41:40 user nova-compute[76442]:         <nova:project uuid="69cc7950cfcf40b180d65bc96e28a2e3">tempest-ServerRescueNegativeTestJSON-916964129</nova:project>
Nov 14 20:41:40 user nova-compute[76442]:       </nova:owner>
Nov 14 20:41:40 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:41:40 user nova-compute[76442]:       <nova:ports>
Nov 14 20:41:40 user nova-compute[76442]:         <nova:port uuid="54c7f1f0-36f9-40ec-9349-81a3a62afe53">
Nov 14 20:41:40 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 20:41:40 user nova-compute[76442]:         </nova:port>
Nov 14 20:41:40 user nova-compute[76442]:       </nova:ports>
Nov 14 20:41:40 user nova-compute[76442]:     </nova:instance>
Nov 14 20:41:40 user nova-compute[76442]:   </metadata>
Nov 14 20:41:40 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:41:40 user nova-compute[76442]:     <system>
Nov 14 20:41:40 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:41:40 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:41:40 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:41:40 user nova-compute[76442]:       <entry name="serial">f9200286-76da-4cc2-8592-c46cfbd5e83e</entry>
Nov 14 20:41:40 user nova-compute[76442]:       <entry name="uuid">f9200286-76da-4cc2-8592-c46cfbd5e83e</entry>
Nov 14 20:41:40 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:41:40 user nova-compute[76442]:     </system>
Nov 14 20:41:40 user nova-compute[76442]:   </sysinfo>
Nov 14 20:41:40 user nova-compute[76442]:   <os>
Nov 14 20:41:40 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:41:40 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:41:40 user nova-compute[76442]:   </os>
Nov 14 20:41:40 user nova-compute[76442]:   <features>
Nov 14 20:41:40 user nova-compute[76442]:     <acpi/>
Nov 14 20:41:40 user nova-compute[76442]:     <apic/>
Nov 14 20:41:40 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:41:40 user nova-compute[76442]:   </features>
Nov 14 20:41:40 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:41:40 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:41:40 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:41:40 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:41:40 user nova-compute[76442]:   </clock>
Nov 14 20:41:40 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:41:40 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:41:40 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:41:40 user nova-compute[76442]:   </cpu>
Nov 14 20:41:40 user nova-compute[76442]:   <devices>
Nov 14 20:41:40 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:41:40 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:41:40 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue"/>
Nov 14 20:41:40 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:41:40 user nova-compute[76442]:     </disk>
Nov 14 20:41:40 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:41:40 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:41:40 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk"/>
Nov 14 20:41:40 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:41:40 user nova-compute[76442]:     </disk>
Nov 14 20:41:40 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:41:40 user nova-compute[76442]:       <mac address="fa:16:3e:f4:af:b5"/>
Nov 14 20:41:40 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:41:40 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:41:40 user nova-compute[76442]:       <target dev="tap54c7f1f0-36"/>
Nov 14 20:41:40 user nova-compute[76442]:     </interface>
Nov 14 20:41:40 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:41:40 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/console.log" append="off"/>
Nov 14 20:41:40 user nova-compute[76442]:     </serial>
Nov 14 20:41:40 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:41:40 user nova-compute[76442]:     <video>
Nov 14 20:41:40 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:41:40 user nova-compute[76442]:     </video>
Nov 14 20:41:40 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:41:40 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:41:40 user nova-compute[76442]:     </rng>
Nov 14 20:41:40 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:41:40 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:41:40 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:41:40 user nova-compute[76442]:     </memballoon>
Nov 14 20:41:40 user nova-compute[76442]:   </devices>
Nov 14 20:41:40 user nova-compute[76442]: </domain>
Nov 14 20:41:40 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:41:40 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Instance destroyed successfully.
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:41:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No VIF found with MAC fa:16:3e:f4:af:b5, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:41:41 user nova-compute[76442]: INFO nova.compute.claims [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Claim successful on node user
Nov 14 20:41:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG nova.compute.manager [req-6162ad4b-b12a-4adb-a3a7-96dafca15da1 req-1b180dd7-1bd5-4d29-8105-ff58fd864296 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6162ad4b-b12a-4adb-a3a7-96dafca15da1 req-1b180dd7-1bd5-4d29-8105-ff58fd864296 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6162ad4b-b12a-4adb-a3a7-96dafca15da1 req-1b180dd7-1bd5-4d29-8105-ff58fd864296 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6162ad4b-b12a-4adb-a3a7-96dafca15da1 req-1b180dd7-1bd5-4d29-8105-ff58fd864296 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG nova.compute.manager [req-6162ad4b-b12a-4adb-a3a7-96dafca15da1 req-1b180dd7-1bd5-4d29-8105-ff58fd864296 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:41 user nova-compute[76442]: WARNING nova.compute.manager [req-6162ad4b-b12a-4adb-a3a7-96dafca15da1 req-1b180dd7-1bd5-4d29-8105-ff58fd864296 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state active and task_state rescuing.
Nov 14 20:41:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:41:42 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:41:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:41:42 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Creating image(s)
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "/opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "/opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "/opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG nova.policy [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05ec208e91594c36a30683258c9c687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd9ff5bbf1a49cca0d72a3ab4b34432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk 1073741824" returned: 0 in 0.055s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Successfully created port: ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Cannot resize image /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Ensure instance console log exists: /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:43 user nova-compute[76442]: WARNING nova.compute.manager [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state active and task_state rescuing.
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:43 user nova-compute[76442]: WARNING nova.compute.manager [req-d1f9ccc6-25f1-4936-a817-e254092cd53f req-2d514706-6f6f-4d8a-86e4-ce34c950fe66 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state active and task_state rescuing.
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Successfully updated port: ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "refresh_cache-a48740e3-01af-4599-91d9-8715bc3f8b3e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquired lock "refresh_cache-a48740e3-01af-4599-91d9-8715bc3f8b3e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:41:43 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Updating instance_info_cache with network_info: [{"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Releasing lock "refresh_cache-a48740e3-01af-4599-91d9-8715bc3f8b3e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Instance network_info: |[{"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Start _get_guest_xml network_info=[{"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:41:44 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:41:44 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-198642135',display_name='tempest-AttachVolumeNegativeTest-server-198642135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-198642135',id=22,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcnmsED655i8pklIdsCimEWL5blddTPz6jD40oSyjnDIq8HSo1q/gH/5Gpg6jWoylLQ+3jqlidXKj967zqPtz2L/XSiuUiO8LMNQSoHhSBo++XJDhXbqioywa0L2uWZ6w==',key_name='tempest-keypair-180261515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-5nthnlxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=a48740e3-01af-4599-91d9-8715bc3f8b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:87:39,bridge_name='br-int',has_traffic_filtering=True,id=ad752cd2-4691-4d90-bb08-ccbfe1e7795c,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad752cd2-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.objects.instance [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'pci_devices' on Instance uuid a48740e3-01af-4599-91d9-8715bc3f8b3e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a4bac2d8-7745-48d5-b5ea-b310da64bdd4 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:41:44 user nova-compute[76442]:   <uuid>a48740e3-01af-4599-91d9-8715bc3f8b3e</uuid>
Nov 14 20:41:44 user nova-compute[76442]:   <name>instance-00000016</name>
Nov 14 20:41:44 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:41:44 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:41:44 user nova-compute[76442]:   <metadata>
Nov 14 20:41:44 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:41:44 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:41:44 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeNegativeTest-server-198642135</nova:name>
Nov 14 20:41:44 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:41:44</nova:creationTime>
Nov 14 20:41:44 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:41:44 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:41:44 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:41:44 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:41:44 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:41:44 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:41:44 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:41:44 user nova-compute[76442]:       <nova:owner>
Nov 14 20:41:44 user nova-compute[76442]:         <nova:user uuid="05ec208e91594c36a30683258c9c687d">tempest-AttachVolumeNegativeTest-1957433764-project-member</nova:user>
Nov 14 20:41:44 user nova-compute[76442]:         <nova:project uuid="5bd9ff5bbf1a49cca0d72a3ab4b34432">tempest-AttachVolumeNegativeTest-1957433764</nova:project>
Nov 14 20:41:44 user nova-compute[76442]:       </nova:owner>
Nov 14 20:41:44 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:41:44 user nova-compute[76442]:       <nova:ports>
Nov 14 20:41:44 user nova-compute[76442]:         <nova:port uuid="ad752cd2-4691-4d90-bb08-ccbfe1e7795c">
Nov 14 20:41:44 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 20:41:44 user nova-compute[76442]:         </nova:port>
Nov 14 20:41:44 user nova-compute[76442]:       </nova:ports>
Nov 14 20:41:44 user nova-compute[76442]:     </nova:instance>
Nov 14 20:41:44 user nova-compute[76442]:   </metadata>
Nov 14 20:41:44 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:41:44 user nova-compute[76442]:     <system>
Nov 14 20:41:44 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:41:44 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:41:44 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:41:44 user nova-compute[76442]:       <entry name="serial">a48740e3-01af-4599-91d9-8715bc3f8b3e</entry>
Nov 14 20:41:44 user nova-compute[76442]:       <entry name="uuid">a48740e3-01af-4599-91d9-8715bc3f8b3e</entry>
Nov 14 20:41:44 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:41:44 user nova-compute[76442]:     </system>
Nov 14 20:41:44 user nova-compute[76442]:   </sysinfo>
Nov 14 20:41:44 user nova-compute[76442]:   <os>
Nov 14 20:41:44 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:41:44 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:41:44 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:41:44 user nova-compute[76442]:   </os>
Nov 14 20:41:44 user nova-compute[76442]:   <features>
Nov 14 20:41:44 user nova-compute[76442]:     <acpi/>
Nov 14 20:41:44 user nova-compute[76442]:     <apic/>
Nov 14 20:41:44 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:41:44 user nova-compute[76442]:   </features>
Nov 14 20:41:44 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:41:44 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:41:44 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:41:44 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:41:44 user nova-compute[76442]:   </clock>
Nov 14 20:41:44 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:41:44 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:41:44 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:41:44 user nova-compute[76442]:   </cpu>
Nov 14 20:41:44 user nova-compute[76442]:   <devices>
Nov 14 20:41:44 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:41:44 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:41:44 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk"/>
Nov 14 20:41:44 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:41:44 user nova-compute[76442]:     </disk>
Nov 14 20:41:44 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:41:44 user nova-compute[76442]:       <mac address="fa:16:3e:ba:87:39"/>
Nov 14 20:41:44 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:41:44 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:41:44 user nova-compute[76442]:       <target dev="tapad752cd2-46"/>
Nov 14 20:41:44 user nova-compute[76442]:     </interface>
Nov 14 20:41:44 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:41:44 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/console.log" append="off"/>
Nov 14 20:41:44 user nova-compute[76442]:     </serial>
Nov 14 20:41:44 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:41:44 user nova-compute[76442]:     <video>
Nov 14 20:41:44 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:41:44 user nova-compute[76442]:     </video>
Nov 14 20:41:44 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:41:44 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:41:44 user nova-compute[76442]:     </rng>
Nov 14 20:41:44 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:41:44 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:41:44 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:41:44 user nova-compute[76442]:     </memballoon>
Nov 14 20:41:44 user nova-compute[76442]:   </devices>
Nov 14 20:41:44 user nova-compute[76442]: </domain>
Nov 14 20:41:44 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-198642135',display_name='tempest-AttachVolumeNegativeTest-server-198642135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-198642135',id=22,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcnmsED655i8pklIdsCimEWL5blddTPz6jD40oSyjnDIq8HSo1q/gH/5Gpg6jWoylLQ+3jqlidXKj967zqPtz2L/XSiuUiO8LMNQSoHhSBo++XJDhXbqioywa0L2uWZ6w==',key_name='tempest-keypair-180261515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-5nthnlxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=a48740e3-01af-4599-91d9-8715bc3f8b3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:87:39,bridge_name='br-int',has_traffic_filtering=True,id=ad752cd2-4691-4d90-bb08-ccbfe1e7795c,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad752cd2-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG os_vif [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:87:39,bridge_name='br-int',has_traffic_filtering=True,id=ad752cd2-4691-4d90-bb08-ccbfe1e7795c,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad752cd2-46') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40b9b5b0-5f86-5751-b060-989d4d2e034a', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad752cd2-46, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad752cd2-46, col_values=(('qos', UUID('0e92457c-4400-4fc6-b1be-ae550c64cd41')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad752cd2-46, col_values=(('external_ids', {'iface-id': 'ad752cd2-4691-4d90-bb08-ccbfe1e7795c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:87:39', 'vm-uuid': 'a48740e3-01af-4599-91d9-8715bc3f8b3e'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:44 user nova-compute[76442]: INFO os_vif [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:87:39,bridge_name='br-int',has_traffic_filtering=True,id=ad752cd2-4691-4d90-bb08-ccbfe1e7795c,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad752cd2-46')
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:41:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No VIF found with MAC fa:16:3e:ba:87:39, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-26de1b45-3327-478d-9fc1-dce49386f333 req-b5b816fa-df8e-43ac-9b97-49127e6ec4d1 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received event network-changed-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-26de1b45-3327-478d-9fc1-dce49386f333 req-b5b816fa-df8e-43ac-9b97-49127e6ec4d1 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Refreshing instance network info cache due to event network-changed-ad752cd2-4691-4d90-bb08-ccbfe1e7795c. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26de1b45-3327-478d-9fc1-dce49386f333 req-b5b816fa-df8e-43ac-9b97-49127e6ec4d1 service nova] Acquiring lock "refresh_cache-a48740e3-01af-4599-91d9-8715bc3f8b3e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26de1b45-3327-478d-9fc1-dce49386f333 req-b5b816fa-df8e-43ac-9b97-49127e6ec4d1 service nova] Acquired lock "refresh_cache-a48740e3-01af-4599-91d9-8715bc3f8b3e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG nova.network.neutron [req-26de1b45-3327-478d-9fc1-dce49386f333 req-b5b816fa-df8e-43ac-9b97-49127e6ec4d1 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Refreshing network info cache for port ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-1ebd735d-6257-44db-82e3-5c4e827d6666 req-7db9a595-8d93-4814-b9e0-a17d76acfa71 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received event network-vif-plugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1ebd735d-6257-44db-82e3-5c4e827d6666 req-7db9a595-8d93-4814-b9e0-a17d76acfa71 service nova] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1ebd735d-6257-44db-82e3-5c4e827d6666 req-7db9a595-8d93-4814-b9e0-a17d76acfa71 service nova] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1ebd735d-6257-44db-82e3-5c4e827d6666 req-7db9a595-8d93-4814-b9e0-a17d76acfa71 service nova] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-1ebd735d-6257-44db-82e3-5c4e827d6666 req-7db9a595-8d93-4814-b9e0-a17d76acfa71 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] No waiting events found dispatching network-vif-plugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:45 user nova-compute[76442]: WARNING nova.compute.manager [req-1ebd735d-6257-44db-82e3-5c4e827d6666 req-7db9a595-8d93-4814-b9e0-a17d76acfa71 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received unexpected event network-vif-plugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c for instance with vm_state building and task_state spawning.
Nov 14 20:41:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-26de1b45-3327-478d-9fc1-dce49386f333 req-b5b816fa-df8e-43ac-9b97-49127e6ec4d1 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Updated VIF entry in instance network info cache for port ad752cd2-4691-4d90-bb08-ccbfe1e7795c. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:41:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-26de1b45-3327-478d-9fc1-dce49386f333 req-b5b816fa-df8e-43ac-9b97-49127e6ec4d1 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Updating instance_info_cache with network_info: [{"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26de1b45-3327-478d-9fc1-dce49386f333 req-b5b816fa-df8e-43ac-9b97-49127e6ec4d1 service nova] Releasing lock "refresh_cache-a48740e3-01af-4599-91d9-8715bc3f8b3e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:41:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:47 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 is timed out.
Nov 14 20:41:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Successfully detached device vdb from instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 from the live domain config.
Nov 14 20:41:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUckjItg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:41:47 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3a25fe-9610-4680-a32f-75d7c4aea1f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:41:47 user nova-compute[76442]: No targets found.
Nov 14 20:41:47 user nova-compute[76442]: iSNS:
Nov 14 20:41:47 user nova-compute[76442]: No targets found.
Nov 14 20:41:47 user nova-compute[76442]: STATIC:
Nov 14 20:41:47 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7
Nov 14 20:41:47 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:47 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:47 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b
Nov 14 20:41:47 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:47 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:47 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:41:47 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:41:47 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:41:47 user nova-compute[76442]: FIRMWARE:
Nov 14 20:41:47 user nova-compute[76442]: No targets found.
Nov 14 20:41:47 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:41:47 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:41:47 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8922ce-7250-4b8e-91b5-25d15660fcd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca46555-5c34-4291-899e-9c3c5683b76c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:47 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:47 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:47 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:41:47 user nova-compute[76442]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 (non-flash)
Nov 14 20:41:47 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:41:47 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4e6cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be9cd6b-b8c8-4a23-93d8-ca82c830a29e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a8b37e-b48e-428b-96fb-0e8aa209b698]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5fb7f6-8c53-477f-aa51-2cee1bbc5cdd]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d8cb33-e94f-46ba-9106-fd1a52b51dd8]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a438b5-111b-49c3-84ff-6f86fe6f8c04]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09f6eb3-da3c-4120-8243-c92111dc0200]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7, portal: 172.16.0.220,3260]
Nov 14 20:41:47 user nova-compute[76442]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7, portal: 172.16.0.220,3260] successful.
Nov 14 20:41:47 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff97a4a3-4c08-4e92-a262-79805755fce7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dfd29d-7a78-4229-8606-54c71a4775bd]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] <== disconnect_volume: return (296ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:41:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:41:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Instance spawned successfully.
Nov 14 20:41:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-860400c8-fd82-4347-9737-b732f1d00c7a req-400283c1-614d-4126-b7b6-4e09ef7c9845 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received event network-vif-plugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-860400c8-fd82-4347-9737-b732f1d00c7a req-400283c1-614d-4126-b7b6-4e09ef7c9845 service nova] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-860400c8-fd82-4347-9737-b732f1d00c7a req-400283c1-614d-4126-b7b6-4e09ef7c9845 service nova] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-860400c8-fd82-4347-9737-b732f1d00c7a req-400283c1-614d-4126-b7b6-4e09ef7c9845 service nova] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-860400c8-fd82-4347-9737-b732f1d00c7a req-400283c1-614d-4126-b7b6-4e09ef7c9845 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] No waiting events found dispatching network-vif-plugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:41:48 user nova-compute[76442]: WARNING nova.compute.manager [req-860400c8-fd82-4347-9737-b732f1d00c7a req-400283c1-614d-4126-b7b6-4e09ef7c9845 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received unexpected event network-vif-plugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c for instance with vm_state building and task_state spawning.
Nov 14 20:41:48 user nova-compute[76442]: INFO nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:41:48 user nova-compute[76442]: INFO nova.compute.manager [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Took 6.60 seconds to build instance.
Nov 14 20:41:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cb9186d8-f1f9-46a8-abbf-64427f20bdc7 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.699s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'flavor' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:41:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a4498739-fce5-4cec-a455-8a69bc865d24 tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.834s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:41:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3655343-0735-48b8-8a0f-1a8a0a23615a req-5b7e23db-524f-4564-81d2-68b1c22641b0 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received event network-changed-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:41:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3655343-0735-48b8-8a0f-1a8a0a23615a req-5b7e23db-524f-4564-81d2-68b1c22641b0 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Refreshing instance network info cache due to event network-changed-0b8cae45-a556-4485-b884-75f84893d0dd. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:41:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3655343-0735-48b8-8a0f-1a8a0a23615a req-5b7e23db-524f-4564-81d2-68b1c22641b0 service nova] Acquiring lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:41:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3655343-0735-48b8-8a0f-1a8a0a23615a req-5b7e23db-524f-4564-81d2-68b1c22641b0 service nova] Acquired lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:41:52 user nova-compute[76442]: DEBUG nova.network.neutron [req-e3655343-0735-48b8-8a0f-1a8a0a23615a req-5b7e23db-524f-4564-81d2-68b1c22641b0 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Refreshing network info cache for port 0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:41:53 user nova-compute[76442]: DEBUG nova.network.neutron [req-e3655343-0735-48b8-8a0f-1a8a0a23615a req-5b7e23db-524f-4564-81d2-68b1c22641b0 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updated VIF entry in instance network info cache for port 0b8cae45-a556-4485-b884-75f84893d0dd. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:41:53 user nova-compute[76442]: DEBUG nova.network.neutron [req-e3655343-0735-48b8-8a0f-1a8a0a23615a req-5b7e23db-524f-4564-81d2-68b1c22641b0 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updating instance_info_cache with network_info: [{"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:41:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3655343-0735-48b8-8a0f-1a8a0a23615a req-5b7e23db-524f-4564-81d2-68b1c22641b0 service nova] Releasing lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:41:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:41:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:41:54 user nova-compute[76442]: INFO nova.compute.manager [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Detaching volume 80d15607-6f9e-4a9e-97c6-cf990b85439b
Nov 14 20:41:54 user nova-compute[76442]: INFO nova.virt.block_device [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Attempting to driver detach volume 80d15607-6f9e-4a9e-97c6-cf990b85439b from mountpoint /dev/vdb
Nov 14 20:41:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Attempting to detach device vdb from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:41:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:41:54 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:41:54 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:41:54 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:41:54 user nova-compute[76442]:   <serial>80d15607-6f9e-4a9e-97c6-cf990b85439b</serial>
Nov 14 20:41:54 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:41:54 user nova-compute[76442]: </disk>
Nov 14 20:41:54 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:41:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Successfully detached device vdb from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 from the persistent domain config.
Nov 14 20:41:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:41:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:41:54 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:41:54 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:41:54 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:41:54 user nova-compute[76442]:   <serial>80d15607-6f9e-4a9e-97c6-cf990b85439b</serial>
Nov 14 20:41:54 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:41:54 user nova-compute[76442]: </disk>
Nov 14 20:41:54 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:41:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:41:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:57 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:41:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:41:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:41:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:41:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:41:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:42:01 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:42:01 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:42:01 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:42:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:01 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:42:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:42:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:42:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7451MB free_disk=25.12872314453125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3f966f64-95e9-4de8-8464-a7ed018b8db6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a7a0fef1-0074-4b13-8e19-880a1333cc95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 31c7399a-07f6-40d7-a62c-8fa374193ba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ae48904c-9a76-40aa-8566-5cfbeb68a359 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a48740e3-01af-4599-91d9-8715bc3f8b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:42:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:42:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:42:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 20:42:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:42:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:42:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:42:09 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid a5970cb5-3f09-43c8-93ac-03053bc2f2cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:42:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updating instance_info_cache with network_info: [{"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:42:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:42:10 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:42:10 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:42:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:42:13 user nova-compute[76442]: INFO nova.compute.claims [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Claim successful on node user
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:42:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.policy [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '497dbbf201694a4e99ba98ebb9cf8e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bc76da5dd841a88a4c8bba03e288aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:42:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Creating image(s)
Nov 14 20:42:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "/opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "/opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "/opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk 1073741824" returned: 0 in 0.065s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Successfully created port: 9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.202s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Cannot resize image /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Ensure instance console log exists: /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Successfully updated port: 9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquired lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-5c68fb0d-f032-4354-bae2-4b8ac4f896d9 req-98f7304c-4a21-4f6a-9388-23dcbc0a64f1 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-changed-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-5c68fb0d-f032-4354-bae2-4b8ac4f896d9 req-98f7304c-4a21-4f6a-9388-23dcbc0a64f1 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Refreshing instance network info cache due to event network-changed-9d5ec5ad-760e-438c-9e3b-b178e43f9e98. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5c68fb0d-f032-4354-bae2-4b8ac4f896d9 req-98f7304c-4a21-4f6a-9388-23dcbc0a64f1 service nova] Acquiring lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:42:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 is timed out.
Nov 14 20:42:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Successfully detached device vdb from instance a7a0fef1-0074-4b13-8e19-880a1333cc95 from the live domain config.
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxeqNspl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:42:15 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[88273121-173b-4299-ba48-b76319de3794]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:42:15 user nova-compute[76442]: No targets found.
Nov 14 20:42:15 user nova-compute[76442]: iSNS:
Nov 14 20:42:15 user nova-compute[76442]: No targets found.
Nov 14 20:42:15 user nova-compute[76442]: STATIC:
Nov 14 20:42:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b
Nov 14 20:42:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:42:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:42:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:42:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:42:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:42:15 user nova-compute[76442]: FIRMWARE:
Nov 14 20:42:15 user nova-compute[76442]: No targets found.
Nov 14 20:42:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:42:15 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:42:15 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eb0bd7-4197-4701-9a4c-7241945a4090]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating instance_info_cache with network_info: [{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8cb174-c2ec-4871-8ad3-367b1c5a3a2f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:42:15 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:42:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:42:15 user nova-compute[76442]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b (non-flash)
Nov 14 20:42:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07143f7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b'): ({'sde'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Removing single pathed devices sde {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Releasing lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance network_info: |[{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5c68fb0d-f032-4354-bae2-4b8ac4f896d9 req-98f7304c-4a21-4f6a-9388-23dcbc0a64f1 service nova] Acquired lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-5c68fb0d-f032-4354-bae2-4b8ac4f896d9 req-98f7304c-4a21-4f6a-9388-23dcbc0a64f1 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Refreshing network info cache for port 9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Start _get_guest_xml network_info=[{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:42:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:42:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c983963-01ed-4137-8271-191a6f6f74c6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172479319',display_name='tempest-ServerActionsTestOtherB-server-172479319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172479319',id=23,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1w5ZQtpg99v5QhQpY/KBiq/xXDr7VzQC2xw087O/wNCNSflAIntMOx1Fw4GV4r8zvn0kw90vwhVLFroQhtXcr2jLFgnpFnY97fquWjOk/BVWAbsopYRXAkQYhcW7Uxdw==',key_name='tempest-keypair-1429056730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05bc76da5dd841a88a4c8bba03e288aa',ramdisk_id='',reservation_id='r-fh10qe39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2105462622',owner_user_name='tempest-ServerActionsTestOtherB-2105462622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497dbbf201694a4e99ba98ebb9cf8e1a',uuid=2458523e-c461-4cd5-903c-2d7ab0222162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converting VIF {"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.objects.instance [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lazy-loading 'pci_devices' on Instance uuid 2458523e-c461-4cd5-903c-2d7ab0222162 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fd760f-91dc-417a-80c5-81310a4d7f27]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Flushing IO for device /dev/sde {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:42:15 user nova-compute[76442]:   <uuid>2458523e-c461-4cd5-903c-2d7ab0222162</uuid>
Nov 14 20:42:15 user nova-compute[76442]:   <name>instance-00000017</name>
Nov 14 20:42:15 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:42:15 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:42:15 user nova-compute[76442]:   <metadata>
Nov 14 20:42:15 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:42:15 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:42:15 user nova-compute[76442]:       <nova:name>tempest-ServerActionsTestOtherB-server-172479319</nova:name>
Nov 14 20:42:15 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:42:15</nova:creationTime>
Nov 14 20:42:15 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:42:15 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:42:15 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:42:15 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:42:15 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:42:15 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:42:15 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:42:15 user nova-compute[76442]:       <nova:owner>
Nov 14 20:42:15 user nova-compute[76442]:         <nova:user uuid="497dbbf201694a4e99ba98ebb9cf8e1a">tempest-ServerActionsTestOtherB-2105462622-project-member</nova:user>
Nov 14 20:42:15 user nova-compute[76442]:         <nova:project uuid="05bc76da5dd841a88a4c8bba03e288aa">tempest-ServerActionsTestOtherB-2105462622</nova:project>
Nov 14 20:42:15 user nova-compute[76442]:       </nova:owner>
Nov 14 20:42:15 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:42:15 user nova-compute[76442]:       <nova:ports>
Nov 14 20:42:15 user nova-compute[76442]:         <nova:port uuid="9d5ec5ad-760e-438c-9e3b-b178e43f9e98">
Nov 14 20:42:15 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 20:42:15 user nova-compute[76442]:         </nova:port>
Nov 14 20:42:15 user nova-compute[76442]:       </nova:ports>
Nov 14 20:42:15 user nova-compute[76442]:     </nova:instance>
Nov 14 20:42:15 user nova-compute[76442]:   </metadata>
Nov 14 20:42:15 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:42:15 user nova-compute[76442]:     <system>
Nov 14 20:42:15 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:42:15 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:42:15 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:42:15 user nova-compute[76442]:       <entry name="serial">2458523e-c461-4cd5-903c-2d7ab0222162</entry>
Nov 14 20:42:15 user nova-compute[76442]:       <entry name="uuid">2458523e-c461-4cd5-903c-2d7ab0222162</entry>
Nov 14 20:42:15 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:42:15 user nova-compute[76442]:     </system>
Nov 14 20:42:15 user nova-compute[76442]:   </sysinfo>
Nov 14 20:42:15 user nova-compute[76442]:   <os>
Nov 14 20:42:15 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:42:15 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:42:15 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:42:15 user nova-compute[76442]:   </os>
Nov 14 20:42:15 user nova-compute[76442]:   <features>
Nov 14 20:42:15 user nova-compute[76442]:     <acpi/>
Nov 14 20:42:15 user nova-compute[76442]:     <apic/>
Nov 14 20:42:15 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:42:15 user nova-compute[76442]:   </features>
Nov 14 20:42:15 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:42:15 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:42:15 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:42:15 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:42:15 user nova-compute[76442]:   </clock>
Nov 14 20:42:15 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:42:15 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:42:15 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:42:15 user nova-compute[76442]:   </cpu>
Nov 14 20:42:15 user nova-compute[76442]:   <devices>
Nov 14 20:42:15 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:42:15 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:42:15 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk"/>
Nov 14 20:42:15 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:42:15 user nova-compute[76442]:     </disk>
Nov 14 20:42:15 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:42:15 user nova-compute[76442]:       <mac address="fa:16:3e:6f:d7:73"/>
Nov 14 20:42:15 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:42:15 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:42:15 user nova-compute[76442]:       <target dev="tap9d5ec5ad-76"/>
Nov 14 20:42:15 user nova-compute[76442]:     </interface>
Nov 14 20:42:15 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:42:15 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/console.log" append="off"/>
Nov 14 20:42:15 user nova-compute[76442]:     </serial>
Nov 14 20:42:15 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:42:15 user nova-compute[76442]:     <video>
Nov 14 20:42:15 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:42:15 user nova-compute[76442]:     </video>
Nov 14 20:42:15 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:42:15 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:42:15 user nova-compute[76442]:     </rng>
Nov 14 20:42:15 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:42:15 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:42:15 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:42:15 user nova-compute[76442]:     </memballoon>
Nov 14 20:42:15 user nova-compute[76442]:   </devices>
Nov 14 20:42:15 user nova-compute[76442]: </domain>
Nov 14 20:42:15 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172479319',display_name='tempest-ServerActionsTestOtherB-server-172479319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172479319',id=23,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1w5ZQtpg99v5QhQpY/KBiq/xXDr7VzQC2xw087O/wNCNSflAIntMOx1Fw4GV4r8zvn0kw90vwhVLFroQhtXcr2jLFgnpFnY97fquWjOk/BVWAbsopYRXAkQYhcW7Uxdw==',key_name='tempest-keypair-1429056730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05bc76da5dd841a88a4c8bba03e288aa',ramdisk_id='',reservation_id='r-fh10qe39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2105462622',owner_user_name='tempest-ServerActionsTestOtherB-2105462622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497dbbf201694a4e99ba98ebb9cf8e1a',uuid=2458523e-c461-4cd5-903c-2d7ab0222162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converting VIF {"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_vif [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[844c5d89-393b-4054-bf26-87fa11a9e553]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '104e645e-b74a-56b1-86e9-a7a7e14cfddc', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d5ec5ad-76, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d5ec5ad-76, col_values=(('qos', UUID('b93b6ee0-696d-4a7b-9522-ca8e1a43f5ab')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d5ec5ad-76, col_values=(('external_ids', {'iface-id': '9d5ec5ad-760e-438c-9e3b-b178e43f9e98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:d7:73', 'vm-uuid': '2458523e-c461-4cd5-903c-2d7ab0222162'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a7b5ae-fbd6-4e8e-8ee6-dae7d3a17a45]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:15 user nova-compute[76442]: INFO os_vif [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76')
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[460fc77f-5837-495a-b3d6-a377639f3f09]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] No VIF found with MAC fa:16:3e:6f:d7:73, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8fe4a0-bb86-4006-af7d-bb254ad7147e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b, portal: 172.16.0.220,3260]
Nov 14 20:42:15 user nova-compute[76442]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b, portal: 172.16.0.220,3260] successful.
Nov 14 20:42:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d15607-6f9e-4a9e-97c6-cf990b85439b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9810ab-907c-45f1-87bb-45d98e78bdeb]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] <== disconnect_volume: return (342ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-5c68fb0d-f032-4354-bae2-4b8ac4f896d9 req-98f7304c-4a21-4f6a-9388-23dcbc0a64f1 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updated VIF entry in instance network info cache for port 9d5ec5ad-760e-438c-9e3b-b178e43f9e98. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-5c68fb0d-f032-4354-bae2-4b8ac4f896d9 req-98f7304c-4a21-4f6a-9388-23dcbc0a64f1 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating instance_info_cache with network_info: [{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:42:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5c68fb0d-f032-4354-bae2-4b8ac4f896d9 req-98f7304c-4a21-4f6a-9388-23dcbc0a64f1 service nova] Releasing lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:42:16 user nova-compute[76442]: DEBUG nova.objects.instance [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lazy-loading 'flavor' on Instance uuid a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:42:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ac19ffa0-13b4-4f79-9510-15aabd1d825f tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.751s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-26feb5aa-87ce-462b-8a44-6bd307d3397b req-85bd8322-efca-4bef-b5cc-35f773806fec service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26feb5aa-87ce-462b-8a44-6bd307d3397b req-85bd8322-efca-4bef-b5cc-35f773806fec service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26feb5aa-87ce-462b-8a44-6bd307d3397b req-85bd8322-efca-4bef-b5cc-35f773806fec service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26feb5aa-87ce-462b-8a44-6bd307d3397b req-85bd8322-efca-4bef-b5cc-35f773806fec service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-26feb5aa-87ce-462b-8a44-6bd307d3397b req-85bd8322-efca-4bef-b5cc-35f773806fec service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:42:17 user nova-compute[76442]: WARNING nova.compute.manager [req-26feb5aa-87ce-462b-8a44-6bd307d3397b req-85bd8322-efca-4bef-b5cc-35f773806fec service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state building and task_state spawning.
Nov 14 20:42:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:17 user nova-compute[76442]: INFO nova.compute.manager [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Terminating instance
Nov 14 20:42:17 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Instance destroyed successfully.
Nov 14 20:42:18 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lazy-loading 'resources' on Instance uuid 3f966f64-95e9-4de8-8464-a7ed018b8db6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-335839947',display_name='tempest-ServerStableDeviceRescueTest-server-335839947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-335839947',id=5,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/XqWsEw0A7lQIR+/+6ZeguQtqwARyySz2E7GtGl2FNgl2f+Q/zJQXKVM2Al5vTWFFKeACaFh/bkGhYeTapvX8ssprXr8Ndv/dc89RmirS6tmlKpy+FydEjDL+sf6jb7w==',key_name='tempest-keypair-1389631806',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec1263fe84fb4684a1a09ca104614513',ramdisk_id='',reservation_id='r-69vsu0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1286396350',owner_user_name='tempest-ServerStableDeviceRescueTest-1286396350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:40:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1af6b467fdcf4757ada855e3d83d11d2',uuid=3f966f64-95e9-4de8-8464-a7ed018b8db6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Converting VIF {"id": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "address": "fa:16:3e:8d:ac:ad", "network": {"id": "dec26ce6-a4d7-44f8-802a-476a75ece865", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-396706094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1263fe84fb4684a1a09ca104614513", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58581ff-74", "ovs_interfaceid": "c58581ff-741a-45f7-a75f-11a6a5ee71ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ac:ad,bridge_name='br-int',has_traffic_filtering=True,id=c58581ff-741a-45f7-a75f-11a6a5ee71ce,network=Network(dec26ce6-a4d7-44f8-802a-476a75ece865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58581ff-74') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG os_vif [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ac:ad,bridge_name='br-int',has_traffic_filtering=True,id=c58581ff-741a-45f7-a75f-11a6a5ee71ce,network=Network(dec26ce6-a4d7-44f8-802a-476a75ece865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58581ff-74') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc58581ff-74, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=924910a8-f6e8-4fe2-8509-41eacc721fd7) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:18 user nova-compute[76442]: INFO os_vif [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:ac:ad,bridge_name='br-int',has_traffic_filtering=True,id=c58581ff-741a-45f7-a75f-11a6a5ee71ce,network=Network(dec26ce6-a4d7-44f8-802a-476a75ece865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58581ff-74')
Nov 14 20:42:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Deleting instance files /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6_del
Nov 14 20:42:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Deletion of /opt/stack/data/nova/instances/3f966f64-95e9-4de8-8464-a7ed018b8db6_del complete
Nov 14 20:42:18 user nova-compute[76442]: INFO nova.compute.manager [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 20:42:18 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:42:18 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:42:19 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Took 0.87 seconds to deallocate network for instance.
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:42:19 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance spawned successfully.
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:42:19 user nova-compute[76442]: WARNING nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state building and task_state spawning.
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-unplugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-unplugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:42:19 user nova-compute[76442]: WARNING nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-unplugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state deleted and task_state None.
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] Acquiring lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] No waiting events found dispatching network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:42:19 user nova-compute[76442]: WARNING nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received unexpected event network-vif-plugged-c58581ff-741a-45f7-a75f-11a6a5ee71ce for instance with vm_state deleted and task_state None.
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-26725c0e-1292-486d-ae8f-9aab74a34ee5 req-1c14cafc-8a52-46a2-8caa-77eb22b308db service nova] [instance: 3f966f64-95e9-4de8-8464-a7ed018b8db6] Received event network-vif-deleted-c58581ff-741a-45f7-a75f-11a6a5ee71ce {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:19 user nova-compute[76442]: INFO nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:42:19 user nova-compute[76442]: INFO nova.compute.manager [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Took 6.22 seconds to build instance.
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bc435bcf-e281-400d-a4d9-82f76f46456e tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.315s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:19 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Deleted allocations for instance 3f966f64-95e9-4de8-8464-a7ed018b8db6
Nov 14 20:42:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9f095824-e0fe-402a-a4c4-22bf01247f9d tempest-ServerStableDeviceRescueTest-1286396350 tempest-ServerStableDeviceRescueTest-1286396350-project-member] Lock "3f966f64-95e9-4de8-8464-a7ed018b8db6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.505s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:42:38 user nova-compute[76442]: INFO nova.compute.claims [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Claim successful on node user
Nov 14 20:42:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.network.neutron [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:42:38 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.policy [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6972c92678b245978e9692d3a75da62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce7cf07105a4357920a0e48d02e38f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:42:38 user nova-compute[76442]: INFO nova.virt.block_device [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Booting with volume 69c8788c-116f-4c6d-9a69-e6ebd291f72f at /dev/vda
Nov 14 20:42:38 user nova-compute[76442]: DEBUG os_brick.utils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8159ac-508b-4ae0-92e6-ae37aa05b912]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86e8865-983f-46a1-a2fd-1dd86e674f77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fefa6f0-bc6c-4155-8c8b-192238a763e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e81b11-4a22-4e26-b027-e4a620239973]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:42:38 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:42:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5de7dae-008e-426c-bcfb-708103ee94e8]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG os_brick.utils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:42:38 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Updating existing volume attachment record: baf12865-7278-449e-9f54-57089f788a99 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:42:39 user nova-compute[76442]: DEBUG nova.network.neutron [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Successfully created port: fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:42:39 user nova-compute[76442]: DEBUG nova.network.neutron [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Successfully updated port: fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:42:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "refresh_cache-3b28c6e1-5191-48fd-be07-d1af671b0695" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:42:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquired lock "refresh_cache-3b28c6e1-5191-48fd-be07-d1af671b0695" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:42:39 user nova-compute[76442]: DEBUG nova.network.neutron [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-e9176902-4733-4f66-a88d-023dfbf4a284 req-726c3ba7-2ef0-4c9a-9faf-157edbd68be5 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-changed-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-e9176902-4733-4f66-a88d-023dfbf4a284 req-726c3ba7-2ef0-4c9a-9faf-157edbd68be5 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Refreshing instance network info cache due to event network-changed-fb8ed0c1-0dd9-4677-b881-904340c8fbf5. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e9176902-4733-4f66-a88d-023dfbf4a284 req-726c3ba7-2ef0-4c9a-9faf-157edbd68be5 service nova] Acquiring lock "refresh_cache-3b28c6e1-5191-48fd-be07-d1af671b0695" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG nova.network.neutron [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG nova.network.neutron [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Updating instance_info_cache with network_info: [{"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Releasing lock "refresh_cache-3b28c6e1-5191-48fd-be07-d1af671b0695" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance network_info: |[{"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e9176902-4733-4f66-a88d-023dfbf4a284 req-726c3ba7-2ef0-4c9a-9faf-157edbd68be5 service nova] Acquired lock "refresh_cache-3b28c6e1-5191-48fd-be07-d1af671b0695" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG nova.network.neutron [req-e9176902-4733-4f66-a88d-023dfbf4a284 req-726c3ba7-2ef0-4c9a-9faf-157edbd68be5 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Refreshing network info cache for port fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG nova.network.neutron [req-e9176902-4733-4f66-a88d-023dfbf4a284 req-726c3ba7-2ef0-4c9a-9faf-157edbd68be5 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Updated VIF entry in instance network info cache for port fb8ed0c1-0dd9-4677-b881-904340c8fbf5. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG nova.network.neutron [req-e9176902-4733-4f66-a88d-023dfbf4a284 req-726c3ba7-2ef0-4c9a-9faf-157edbd68be5 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Updating instance_info_cache with network_info: [{"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:42:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e9176902-4733-4f66-a88d-023dfbf4a284 req-726c3ba7-2ef0-4c9a-9faf-157edbd68be5 service nova] Releasing lock "refresh_cache-3b28c6e1-5191-48fd-be07-d1af671b0695" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:42:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:42:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Creating image(s)
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Ensure instance console log exists: /opt/stack/data/nova/instances/3b28c6e1-5191-48fd-be07-d1af671b0695/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Start _get_guest_xml network_info=[{"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRtcSXzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b28c6e1-5191-48fd-be07-d1af671b0695', 'attached_at': '', 'detached_at': '', 'volume_id': '69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'serial': '69c8788c-116f-4c6d-9a69-e6ebd291f72f'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'baf12865-7278-449e-9f54-57089f788a99', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:42:43 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:42:43 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRtcSXzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:42:43 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:42:43 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:42:43 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a3322c-a7f0-4acc-8302-81b7107af670]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:42:43 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed5ccec-2259-4286-b988-ff3be93d8b79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f] added
Nov 14 20:42:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e6e2f5-9c59-4a17-b4b9-763418f812f8]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[643dbe69-6683-46ef-91df-2a3a52065784]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRtcSXzB {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRtcSXzB" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b844f9ce-e008-40ad-b3f1-7ae584425c23]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRtcSXzB'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[71253d7d-c8dd-4d4d-ba34-d942febe7a9a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abcd1b3-292f-4bfc-8600-16ede1b19847]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:42:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:42:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[16944b98-85cd-4666-9b6f-bde5307d4122]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260]
Nov 14 20:42:43 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260] successful.
Nov 14 20:42:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc48563-7df0-4ccf-a78a-84bc8da466b6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d07cfe6-a648-4684-a93c-002fd94d69c7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:42:43 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:42:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:42:43 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:42:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ac9f2-8089-4208-a879-b9ed32258c0d]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:42:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRtcSXzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26564666235653435', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564666235653435', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-45726840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-45726840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY9gZC8aB/JVqRnz6O+jEJIYx3p8DCBh9I7CmcOwY/m7HTA/XQPaLwT4ucWvMGkpa+45IFG/yxglKz5lQd7V/yRTk6SXIoIm2npdlarA3QE1Y1entI5IU/P4Rc/W1pfyQ==',key_name='tempest-keypair-1596655746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce7cf07105a4357920a0e48d02e38f4',ramdisk_id='',reservation_id='r-jexecte0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1273726129',owner_user_name='tempest-ServerActionsV293TestJSON-1273726129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6972c92678b245978e9692d3a75da62d',uuid=3b28c6e1-5191-48fd-be07-d1af671b0695,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converting VIF {"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.objects.instance [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b28c6e1-5191-48fd-be07-d1af671b0695 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:42:44 user nova-compute[76442]:   <uuid>3b28c6e1-5191-48fd-be07-d1af671b0695</uuid>
Nov 14 20:42:44 user nova-compute[76442]:   <name>instance-00000018</name>
Nov 14 20:42:44 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:42:44 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:42:44 user nova-compute[76442]:   <metadata>
Nov 14 20:42:44 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:42:44 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:42:44 user nova-compute[76442]:       <nova:name>tempest-ServerActionsV293TestJSON-server-45726840</nova:name>
Nov 14 20:42:44 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:42:43</nova:creationTime>
Nov 14 20:42:44 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:42:44 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:42:44 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:42:44 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:42:44 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:42:44 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:42:44 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:42:44 user nova-compute[76442]:       <nova:owner>
Nov 14 20:42:44 user nova-compute[76442]:         <nova:user uuid="6972c92678b245978e9692d3a75da62d">tempest-ServerActionsV293TestJSON-1273726129-project-member</nova:user>
Nov 14 20:42:44 user nova-compute[76442]:         <nova:project uuid="4ce7cf07105a4357920a0e48d02e38f4">tempest-ServerActionsV293TestJSON-1273726129</nova:project>
Nov 14 20:42:44 user nova-compute[76442]:       </nova:owner>
Nov 14 20:42:44 user nova-compute[76442]:       <nova:ports>
Nov 14 20:42:44 user nova-compute[76442]:         <nova:port uuid="fb8ed0c1-0dd9-4677-b881-904340c8fbf5">
Nov 14 20:42:44 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 20:42:44 user nova-compute[76442]:         </nova:port>
Nov 14 20:42:44 user nova-compute[76442]:       </nova:ports>
Nov 14 20:42:44 user nova-compute[76442]:     </nova:instance>
Nov 14 20:42:44 user nova-compute[76442]:   </metadata>
Nov 14 20:42:44 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:42:44 user nova-compute[76442]:     <system>
Nov 14 20:42:44 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:42:44 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:42:44 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:42:44 user nova-compute[76442]:       <entry name="serial">3b28c6e1-5191-48fd-be07-d1af671b0695</entry>
Nov 14 20:42:44 user nova-compute[76442]:       <entry name="uuid">3b28c6e1-5191-48fd-be07-d1af671b0695</entry>
Nov 14 20:42:44 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:42:44 user nova-compute[76442]:     </system>
Nov 14 20:42:44 user nova-compute[76442]:   </sysinfo>
Nov 14 20:42:44 user nova-compute[76442]:   <os>
Nov 14 20:42:44 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:42:44 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:42:44 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:42:44 user nova-compute[76442]:   </os>
Nov 14 20:42:44 user nova-compute[76442]:   <features>
Nov 14 20:42:44 user nova-compute[76442]:     <acpi/>
Nov 14 20:42:44 user nova-compute[76442]:     <apic/>
Nov 14 20:42:44 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:42:44 user nova-compute[76442]:   </features>
Nov 14 20:42:44 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:42:44 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:42:44 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:42:44 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:42:44 user nova-compute[76442]:   </clock>
Nov 14 20:42:44 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:42:44 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:42:44 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:42:44 user nova-compute[76442]:   </cpu>
Nov 14 20:42:44 user nova-compute[76442]:   <devices>
Nov 14 20:42:44 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:42:44 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:42:44 user nova-compute[76442]:       <source dev="/dev/sdc"/>
Nov 14 20:42:44 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:42:44 user nova-compute[76442]:       <serial>69c8788c-116f-4c6d-9a69-e6ebd291f72f</serial>
Nov 14 20:42:44 user nova-compute[76442]:     </disk>
Nov 14 20:42:44 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:42:44 user nova-compute[76442]:       <mac address="fa:16:3e:a9:83:be"/>
Nov 14 20:42:44 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:42:44 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:42:44 user nova-compute[76442]:       <target dev="tapfb8ed0c1-0d"/>
Nov 14 20:42:44 user nova-compute[76442]:     </interface>
Nov 14 20:42:44 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:42:44 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/3b28c6e1-5191-48fd-be07-d1af671b0695/console.log" append="off"/>
Nov 14 20:42:44 user nova-compute[76442]:     </serial>
Nov 14 20:42:44 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:42:44 user nova-compute[76442]:     <video>
Nov 14 20:42:44 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:42:44 user nova-compute[76442]:     </video>
Nov 14 20:42:44 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:42:44 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:42:44 user nova-compute[76442]:     </rng>
Nov 14 20:42:44 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:42:44 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:42:44 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:42:44 user nova-compute[76442]:     </memballoon>
Nov 14 20:42:44 user nova-compute[76442]:   </devices>
Nov 14 20:42:44 user nova-compute[76442]: </domain>
Nov 14 20:42:44 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-45726840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-45726840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY9gZC8aB/JVqRnz6O+jEJIYx3p8DCBh9I7CmcOwY/m7HTA/XQPaLwT4ucWvMGkpa+45IFG/yxglKz5lQd7V/yRTk6SXIoIm2npdlarA3QE1Y1entI5IU/P4Rc/W1pfyQ==',key_name='tempest-keypair-1596655746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce7cf07105a4357920a0e48d02e38f4',ramdisk_id='',reservation_id='r-jexecte0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1273726129',owner_user_name='tempest-ServerActionsV293TestJSON-1273726129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6972c92678b245978e9692d3a75da62d',uuid=3b28c6e1-5191-48fd-be07-d1af671b0695,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converting VIF {"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG os_vif [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6073d60e-2106-54e3-b415-d3d1c0421f21', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb8ed0c1-0d, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb8ed0c1-0d, col_values=(('qos', UUID('e992448f-878c-4526-b278-b342586906c0')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb8ed0c1-0d, col_values=(('external_ids', {'iface-id': 'fb8ed0c1-0dd9-4677-b881-904340c8fbf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:83:be', 'vm-uuid': '3b28c6e1-5191-48fd-be07-d1af671b0695'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:44 user nova-compute[76442]: INFO os_vif [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d')
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:42:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] No VIF found with MAC fa:16:3e:a9:83:be, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:45 user nova-compute[76442]: INFO nova.compute.manager [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Terminating instance
Nov 14 20:42:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-5b2a82ca-6a3e-4a22-b239-edbf60e0f897 req-ad026313-beec-40b7-a7a6-fb6ee62f4bae service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received event network-vif-unplugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5b2a82ca-6a3e-4a22-b239-edbf60e0f897 req-ad026313-beec-40b7-a7a6-fb6ee62f4bae service nova] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5b2a82ca-6a3e-4a22-b239-edbf60e0f897 req-ad026313-beec-40b7-a7a6-fb6ee62f4bae service nova] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5b2a82ca-6a3e-4a22-b239-edbf60e0f897 req-ad026313-beec-40b7-a7a6-fb6ee62f4bae service nova] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-5b2a82ca-6a3e-4a22-b239-edbf60e0f897 req-ad026313-beec-40b7-a7a6-fb6ee62f4bae service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] No waiting events found dispatching network-vif-unplugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:42:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-5b2a82ca-6a3e-4a22-b239-edbf60e0f897 req-ad026313-beec-40b7-a7a6-fb6ee62f4bae service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received event network-vif-unplugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Instance destroyed successfully.
Nov 14 20:42:46 user nova-compute[76442]: DEBUG nova.objects.instance [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lazy-loading 'resources' on Instance uuid a7a0fef1-0074-4b13-8e19-880a1333cc95 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2143960022',display_name='tempest-TestServerVolumeAttachmentScenario-server-2143960022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2143960022',id=15,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq+c6KGiH5C26qPx8Fp8gDoKTGMMFh9H5mAcH4/zUz2/GE2clkDbLo4IGLk1WSwH69mLZQiOwjOBsrvAzrxB3MTEOvFEMUrkkHIg4Yp6epcZScFLAzVXU2BBhZav2SS/Q==',key_name='tempest-keypair-2039224856',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:38:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0103b7d8c44a4504be5a4a1a16f7623f',ramdisk_id='',reservation_id='r-cepbfiw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-932749188',owner_user_name='tempest-TestServerVolumeAttachmentScenario-932749188-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:38:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c34f3a6b9344181989b8f8346dabf8e',uuid=a7a0fef1-0074-4b13-8e19-880a1333cc95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Converting VIF {"id": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "address": "fa:16:3e:54:a3:91", "network": {"id": "a6a46092-4fc9-4321-8d84-875744bddff3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1233247962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0103b7d8c44a4504be5a4a1a16f7623f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a30840-41", "ovs_interfaceid": "07a30840-414e-4ca8-818c-d9e3b3d9e85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:a3:91,bridge_name='br-int',has_traffic_filtering=True,id=07a30840-414e-4ca8-818c-d9e3b3d9e85e,network=Network(a6a46092-4fc9-4321-8d84-875744bddff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a30840-41') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG os_vif [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a3:91,bridge_name='br-int',has_traffic_filtering=True,id=07a30840-414e-4ca8-818c-d9e3b3d9e85e,network=Network(a6a46092-4fc9-4321-8d84-875744bddff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a30840-41') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07a30840-41, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c346b864-f89c-42fa-a3a4-186ff1fa5d3b) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: INFO os_vif [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a3:91,bridge_name='br-int',has_traffic_filtering=True,id=07a30840-414e-4ca8-818c-d9e3b3d9e85e,network=Network(a6a46092-4fc9-4321-8d84-875744bddff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a30840-41')
Nov 14 20:42:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Deleting instance files /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95_del
Nov 14 20:42:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Deletion of /opt/stack/data/nova/instances/a7a0fef1-0074-4b13-8e19-880a1333cc95_del complete
Nov 14 20:42:46 user nova-compute[76442]: INFO nova.compute.manager [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 14 20:42:46 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-cc5f4fc7-86c0-4f04-a10a-4eafe2d2efa7 req-6d0b7d56-6aa2-4230-a5ed-d4103e3df97c service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc5f4fc7-86c0-4f04-a10a-4eafe2d2efa7 req-6d0b7d56-6aa2-4230-a5ed-d4103e3df97c service nova] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc5f4fc7-86c0-4f04-a10a-4eafe2d2efa7 req-6d0b7d56-6aa2-4230-a5ed-d4103e3df97c service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cc5f4fc7-86c0-4f04-a10a-4eafe2d2efa7 req-6d0b7d56-6aa2-4230-a5ed-d4103e3df97c service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-cc5f4fc7-86c0-4f04-a10a-4eafe2d2efa7 req-6d0b7d56-6aa2-4230-a5ed-d4103e3df97c service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] No waiting events found dispatching network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:42:46 user nova-compute[76442]: WARNING nova.compute.manager [req-cc5f4fc7-86c0-4f04-a10a-4eafe2d2efa7 req-6d0b7d56-6aa2-4230-a5ed-d4103e3df97c service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received unexpected event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 for instance with vm_state building and task_state spawning.
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-b9250894-4cde-4c9a-a0ae-886a8c989d42 req-4ffc6094-8909-47c3-b35b-db2509194f82 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received event network-vif-plugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b9250894-4cde-4c9a-a0ae-886a8c989d42 req-4ffc6094-8909-47c3-b35b-db2509194f82 service nova] Acquiring lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b9250894-4cde-4c9a-a0ae-886a8c989d42 req-4ffc6094-8909-47c3-b35b-db2509194f82 service nova] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b9250894-4cde-4c9a-a0ae-886a8c989d42 req-4ffc6094-8909-47c3-b35b-db2509194f82 service nova] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-b9250894-4cde-4c9a-a0ae-886a8c989d42 req-4ffc6094-8909-47c3-b35b-db2509194f82 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] No waiting events found dispatching network-vif-plugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:42:47 user nova-compute[76442]: WARNING nova.compute.manager [req-b9250894-4cde-4c9a-a0ae-886a8c989d42 req-4ffc6094-8909-47c3-b35b-db2509194f82 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received unexpected event network-vif-plugged-07a30840-414e-4ca8-818c-d9e3b3d9e85e for instance with vm_state active and task_state deleting.
Nov 14 20:42:47 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:42:47 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Took 1.07 seconds to deallocate network for instance.
Nov 14 20:42:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:48 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Deleted allocations for instance a7a0fef1-0074-4b13-8e19-880a1333cc95
Nov 14 20:42:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4d3004ec-304c-497a-a826-55ab9e94fbb9 tempest-TestServerVolumeAttachmentScenario-932749188 tempest-TestServerVolumeAttachmentScenario-932749188-project-member] Lock "a7a0fef1-0074-4b13-8e19-880a1333cc95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.095s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:42:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance spawned successfully.
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:42:48 user nova-compute[76442]: INFO nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:42:48 user nova-compute[76442]: INFO nova.compute.manager [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Took 10.67 seconds to build instance.
Nov 14 20:42:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-dd84cea4-791e-4544-97de-38381155896a tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.808s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-2b85470e-3750-405a-8af5-9d3b40aa966a req-f2ec3c6a-0a40-4a57-8f8a-1189eb7e14a4 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2b85470e-3750-405a-8af5-9d3b40aa966a req-f2ec3c6a-0a40-4a57-8f8a-1189eb7e14a4 service nova] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2b85470e-3750-405a-8af5-9d3b40aa966a req-f2ec3c6a-0a40-4a57-8f8a-1189eb7e14a4 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2b85470e-3750-405a-8af5-9d3b40aa966a req-f2ec3c6a-0a40-4a57-8f8a-1189eb7e14a4 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-2b85470e-3750-405a-8af5-9d3b40aa966a req-f2ec3c6a-0a40-4a57-8f8a-1189eb7e14a4 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] No waiting events found dispatching network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:42:48 user nova-compute[76442]: WARNING nova.compute.manager [req-2b85470e-3750-405a-8af5-9d3b40aa966a req-f2ec3c6a-0a40-4a57-8f8a-1189eb7e14a4 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received unexpected event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 for instance with vm_state active and task_state None.
Nov 14 20:42:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-2b85470e-3750-405a-8af5-9d3b40aa966a req-f2ec3c6a-0a40-4a57-8f8a-1189eb7e14a4 service nova] [instance: a7a0fef1-0074-4b13-8e19-880a1333cc95] Received event network-vif-deleted-07a30840-414e-4ca8-818c-d9e3b3d9e85e {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:42:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:42:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:42:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:42:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:00 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 20:43:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:43:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:43:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:01 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:01 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:02 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:43:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "ae48904c-9a76-40aa-8566-5cfbeb68a359" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:05 user nova-compute[76442]: INFO nova.compute.manager [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Terminating instance
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-fa41b493-8716-4235-b290-2dce6d36396c req-b1addd72-a72a-472b-bb09-a2ebde741407 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received event network-vif-unplugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fa41b493-8716-4235-b290-2dce6d36396c req-b1addd72-a72a-472b-bb09-a2ebde741407 service nova] Acquiring lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fa41b493-8716-4235-b290-2dce6d36396c req-b1addd72-a72a-472b-bb09-a2ebde741407 service nova] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fa41b493-8716-4235-b290-2dce6d36396c req-b1addd72-a72a-472b-bb09-a2ebde741407 service nova] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-fa41b493-8716-4235-b290-2dce6d36396c req-b1addd72-a72a-472b-bb09-a2ebde741407 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] No waiting events found dispatching network-vif-unplugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-fa41b493-8716-4235-b290-2dce6d36396c req-b1addd72-a72a-472b-bb09-a2ebde741407 service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received event network-vif-unplugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Instance destroyed successfully.
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.objects.instance [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lazy-loading 'resources' on Instance uuid ae48904c-9a76-40aa-8566-5cfbeb68a359 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:41:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-285386602',display_name='tempest-ServersNegativeTestJSON-server-285386602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-285386602',id=21,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d05a3b23802440898218c51c6f6eb0cf',ramdisk_id='',reservation_id='r-f0zu49qx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-145042559',owner_user_name='tempest-ServersNegativeTestJSON-145042559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:41:23Z,user_data=None,user_id='26d34d0a5ada4aaf84176788da8c781c',uuid=ae48904c-9a76-40aa-8566-5cfbeb68a359,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converting VIF {"id": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "address": "fa:16:3e:7b:1f:c3", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc377bc05-dc", "ovs_interfaceid": "c377bc05-dcd0-45b7-9a21-34d36824b1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1f:c3,bridge_name='br-int',has_traffic_filtering=True,id=c377bc05-dcd0-45b7-9a21-34d36824b1ab,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc377bc05-dc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG os_vif [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1f:c3,bridge_name='br-int',has_traffic_filtering=True,id=c377bc05-dcd0-45b7-9a21-34d36824b1ab,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc377bc05-dc') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc377bc05-dc, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b93e792-e83c-4d50-bdbd-5ced51170986) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:05 user nova-compute[76442]: INFO os_vif [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:1f:c3,bridge_name='br-int',has_traffic_filtering=True,id=c377bc05-dcd0-45b7-9a21-34d36824b1ab,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc377bc05-dc')
Nov 14 20:43:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Deleting instance files /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359_del
Nov 14 20:43:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Deletion of /opt/stack/data/nova/instances/ae48904c-9a76-40aa-8566-5cfbeb68a359_del complete
Nov 14 20:43:05 user nova-compute[76442]: INFO nova.compute.manager [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid 'ae48904c-9a76-40aa-8566-5cfbeb68a359' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ae48904c-9a76-40aa-8566-5cfbeb68a359' (instance-00000015)
Nov 14 20:43:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:06 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7671MB free_disk=25.238460540771484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:06 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Took 0.63 seconds to deallocate network for instance.
Nov 14 20:43:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 31c7399a-07f6-40d7-a62c-8fa374193ba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ae48904c-9a76-40aa-8566-5cfbeb68a359 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a48740e3-01af-4599-91d9-8715bc3f8b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2458523e-c461-4cd5-903c-2d7ab0222162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3b28c6e1-5191-48fd-be07-d1af671b0695 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:43:06 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.365s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:07 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Deleted allocations for instance ae48904c-9a76-40aa-8566-5cfbeb68a359
Nov 14 20:43:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8953e2b6-b4d9-4464-95e6-8aa8b9ccfc5c tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-0fd27ef4-4a44-4a88-a2bb-7bc51de10d0e req-6c115341-98f3-48a4-a78b-935ee597415f service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received event network-vif-plugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0fd27ef4-4a44-4a88-a2bb-7bc51de10d0e req-6c115341-98f3-48a4-a78b-935ee597415f service nova] Acquiring lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0fd27ef4-4a44-4a88-a2bb-7bc51de10d0e req-6c115341-98f3-48a4-a78b-935ee597415f service nova] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0fd27ef4-4a44-4a88-a2bb-7bc51de10d0e req-6c115341-98f3-48a4-a78b-935ee597415f service nova] Lock "ae48904c-9a76-40aa-8566-5cfbeb68a359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-0fd27ef4-4a44-4a88-a2bb-7bc51de10d0e req-6c115341-98f3-48a4-a78b-935ee597415f service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] No waiting events found dispatching network-vif-plugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:07 user nova-compute[76442]: WARNING nova.compute.manager [req-0fd27ef4-4a44-4a88-a2bb-7bc51de10d0e req-6c115341-98f3-48a4-a78b-935ee597415f service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received unexpected event network-vif-plugged-c377bc05-dcd0-45b7-9a21-34d36824b1ab for instance with vm_state deleted and task_state None.
Nov 14 20:43:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-0fd27ef4-4a44-4a88-a2bb-7bc51de10d0e req-6c115341-98f3-48a4-a78b-935ee597415f service nova] [instance: ae48904c-9a76-40aa-8566-5cfbeb68a359] Received event network-vif-deleted-c377bc05-dcd0-45b7-9a21-34d36824b1ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating instance_info_cache with network_info: [{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:09 user nova-compute[76442]: DEBUG nova.objects.instance [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:43:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquired lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:43:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:43:09 user nova-compute[76442]: DEBUG nova.objects.instance [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'info_cache' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:09 user nova-compute[76442]: DEBUG nova.objects.base [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:43:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:10 user nova-compute[76442]: DEBUG nova.network.neutron [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating instance_info_cache with network_info: [{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Releasing lock "refresh_cache-d7c90b52-307d-4a1d-98ab-68449f84c3f2" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:43:11 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance destroyed successfully.
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.instance [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'resources' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.base [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878133652',display_name='tempest-AttachVolumeTestJSON-server-878133652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878133652',id=4,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDheVhyXKd1tLetq6drOD0c1HXCNMGuyk4trFFV+OHU/w0jSDxWd/s0s9dAgCq1IdTQzrf7GK4Rv/3WoY7/OLU1yzzvADVAojoOIUFiIYeEUqj31jXAcxcBX+C/r+XI6AQ==',key_name='tempest-keypair-857353389',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-nein8fe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=d7c90b52-307d-4a1d-98ab-68449f84c3f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG os_vif [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefe55142-46, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae38436f-af13-4def-8045-f3ac8dd2fc5a) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: INFO os_vif [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46')
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Start _get_guest_xml network_info=[{"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.instance [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'numa_topology' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.base [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:43:11 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:11 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.instance [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.base [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878133652',display_name='tempest-AttachVolumeTestJSON-server-878133652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878133652',id=4,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDheVhyXKd1tLetq6drOD0c1HXCNMGuyk4trFFV+OHU/w0jSDxWd/s0s9dAgCq1IdTQzrf7GK4Rv/3WoY7/OLU1yzzvADVAojoOIUFiIYeEUqj31jXAcxcBX+C/r+XI6AQ==',key_name='tempest-keypair-857353389',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-nein8fe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=d7c90b52-307d-4a1d-98ab-68449f84c3f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.instance [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'pci_devices' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.base [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:43:11 user nova-compute[76442]:   <uuid>d7c90b52-307d-4a1d-98ab-68449f84c3f2</uuid>
Nov 14 20:43:11 user nova-compute[76442]:   <name>instance-00000004</name>
Nov 14 20:43:11 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:43:11 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:43:11 user nova-compute[76442]:   <metadata>
Nov 14 20:43:11 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:43:11 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:43:11 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeTestJSON-server-878133652</nova:name>
Nov 14 20:43:11 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:43:11</nova:creationTime>
Nov 14 20:43:11 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:43:11 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:43:11 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:43:11 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:43:11 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:43:11 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:43:11 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:43:11 user nova-compute[76442]:       <nova:owner>
Nov 14 20:43:11 user nova-compute[76442]:         <nova:user uuid="1451459113e244e798fff66799c10c48">tempest-AttachVolumeTestJSON-650801364-project-member</nova:user>
Nov 14 20:43:11 user nova-compute[76442]:         <nova:project uuid="b1e7d9ec7d5342a797576c7e568c1073">tempest-AttachVolumeTestJSON-650801364</nova:project>
Nov 14 20:43:11 user nova-compute[76442]:       </nova:owner>
Nov 14 20:43:11 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:43:11 user nova-compute[76442]:       <nova:ports>
Nov 14 20:43:11 user nova-compute[76442]:         <nova:port uuid="efe55142-461c-40ce-a422-d396af94b09d">
Nov 14 20:43:11 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 20:43:11 user nova-compute[76442]:         </nova:port>
Nov 14 20:43:11 user nova-compute[76442]:       </nova:ports>
Nov 14 20:43:11 user nova-compute[76442]:     </nova:instance>
Nov 14 20:43:11 user nova-compute[76442]:   </metadata>
Nov 14 20:43:11 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:43:11 user nova-compute[76442]:     <system>
Nov 14 20:43:11 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:43:11 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:43:11 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:43:11 user nova-compute[76442]:       <entry name="serial">d7c90b52-307d-4a1d-98ab-68449f84c3f2</entry>
Nov 14 20:43:11 user nova-compute[76442]:       <entry name="uuid">d7c90b52-307d-4a1d-98ab-68449f84c3f2</entry>
Nov 14 20:43:11 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:43:11 user nova-compute[76442]:     </system>
Nov 14 20:43:11 user nova-compute[76442]:   </sysinfo>
Nov 14 20:43:11 user nova-compute[76442]:   <os>
Nov 14 20:43:11 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:43:11 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:43:11 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:43:11 user nova-compute[76442]:   </os>
Nov 14 20:43:11 user nova-compute[76442]:   <features>
Nov 14 20:43:11 user nova-compute[76442]:     <acpi/>
Nov 14 20:43:11 user nova-compute[76442]:     <apic/>
Nov 14 20:43:11 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:43:11 user nova-compute[76442]:   </features>
Nov 14 20:43:11 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:43:11 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:43:11 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:43:11 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:43:11 user nova-compute[76442]:   </clock>
Nov 14 20:43:11 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:43:11 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:43:11 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:43:11 user nova-compute[76442]:   </cpu>
Nov 14 20:43:11 user nova-compute[76442]:   <devices>
Nov 14 20:43:11 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:43:11 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:43:11 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk"/>
Nov 14 20:43:11 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:43:11 user nova-compute[76442]:     </disk>
Nov 14 20:43:11 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:43:11 user nova-compute[76442]:       <mac address="fa:16:3e:d2:0d:f0"/>
Nov 14 20:43:11 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:43:11 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:43:11 user nova-compute[76442]:       <target dev="tapefe55142-46"/>
Nov 14 20:43:11 user nova-compute[76442]:     </interface>
Nov 14 20:43:11 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:43:11 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/console.log" append="off"/>
Nov 14 20:43:11 user nova-compute[76442]:     </serial>
Nov 14 20:43:11 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:43:11 user nova-compute[76442]:     <video>
Nov 14 20:43:11 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:43:11 user nova-compute[76442]:     </video>
Nov 14 20:43:11 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:43:11 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:43:11 user nova-compute[76442]:     </rng>
Nov 14 20:43:11 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:43:11 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:43:11 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:43:11 user nova-compute[76442]:     </memballoon>
Nov 14 20:43:11 user nova-compute[76442]:   </devices>
Nov 14 20:43:11 user nova-compute[76442]: </domain>
Nov 14 20:43:11 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.instance [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'trusted_certs' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.base [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Cannot resize image /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.instance [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'migration_context' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.objects.base [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Object Instance<d7c90b52-307d-4a1d-98ab-68449f84c3f2> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878133652',display_name='tempest-AttachVolumeTestJSON-server-878133652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878133652',id=4,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDheVhyXKd1tLetq6drOD0c1HXCNMGuyk4trFFV+OHU/w0jSDxWd/s0s9dAgCq1IdTQzrf7GK4Rv/3WoY7/OLU1yzzvADVAojoOIUFiIYeEUqj31jXAcxcBX+C/r+XI6AQ==',key_name='tempest-keypair-857353389',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-nein8fe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=d7c90b52-307d-4a1d-98ab-68449f84c3f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG os_vif [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41af6940-7304-5c25-9ae4-97b019a2a897', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefe55142-46, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefe55142-46, col_values=(('qos', UUID('0ae6f1b1-f9c9-4279-a459-6e0110f2b759')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefe55142-46, col_values=(('external_ids', {'iface-id': 'efe55142-461c-40ce-a422-d396af94b09d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:0d:f0', 'vm-uuid': 'd7c90b52-307d-4a1d-98ab-68449f84c3f2'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:11 user nova-compute[76442]: INFO os_vif [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46')
Nov 14 20:43:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-57a46e92-369e-4f5d-9aed-abdd2da1d589 req-cdf3fd25-ba11-492a-a295-4732f30b699b service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57a46e92-369e-4f5d-9aed-abdd2da1d589 req-cdf3fd25-ba11-492a-a295-4732f30b699b service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57a46e92-369e-4f5d-9aed-abdd2da1d589 req-cdf3fd25-ba11-492a-a295-4732f30b699b service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57a46e92-369e-4f5d-9aed-abdd2da1d589 req-cdf3fd25-ba11-492a-a295-4732f30b699b service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-57a46e92-369e-4f5d-9aed-abdd2da1d589 req-cdf3fd25-ba11-492a-a295-4732f30b699b service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:13 user nova-compute[76442]: WARNING nova.compute.manager [req-57a46e92-369e-4f5d-9aed-abdd2da1d589 req-cdf3fd25-ba11-492a-a295-4732f30b699b service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state stopped and task_state powering-on.
Nov 14 20:43:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:43:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance rebooted successfully.
Nov 14 20:43:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-63f00402-3dc9-47fb-b928-8edef04523ed tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:43:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-bf3534e8-81a8-470c-bf1e-4cf7bcd1e86c req-31960a69-f38e-4162-b394-35089842fadb service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bf3534e8-81a8-470c-bf1e-4cf7bcd1e86c req-31960a69-f38e-4162-b394-35089842fadb service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bf3534e8-81a8-470c-bf1e-4cf7bcd1e86c req-31960a69-f38e-4162-b394-35089842fadb service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bf3534e8-81a8-470c-bf1e-4cf7bcd1e86c req-31960a69-f38e-4162-b394-35089842fadb service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-bf3534e8-81a8-470c-bf1e-4cf7bcd1e86c req-31960a69-f38e-4162-b394-35089842fadb service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:15 user nova-compute[76442]: WARNING nova.compute.manager [req-bf3534e8-81a8-470c-bf1e-4cf7bcd1e86c req-31960a69-f38e-4162-b394-35089842fadb service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state active and task_state None.
Nov 14 20:43:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 20:43:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:43:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:43:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "88dd9488-e777-4b33-9702-e8f0353a62c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:43:26 user nova-compute[76442]: INFO nova.compute.claims [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Claim successful on node user
Nov 14 20:43:26 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:43:27 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:43:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG nova.policy [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4163211b006c4fbbbdc575c0e6d02ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83568ed733848d09643843927ca0c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:43:27 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Creating image(s)
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "/opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "/opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "/opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.200s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk 1073741824" returned: 0 in 0.055s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Successfully created port: fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:43:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:28 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Cannot resize image /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:43:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:43:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Ensure instance console log exists: /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:43:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Successfully updated port: fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "refresh_cache-88dd9488-e777-4b33-9702-e8f0353a62c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquired lock "refresh_cache-88dd9488-e777-4b33-9702-e8f0353a62c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-0a59f468-7a4c-4300-8624-f06e5f919449 req-8c420c40-f268-44b4-b448-140260c19824 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received event network-changed-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-0a59f468-7a4c-4300-8624-f06e5f919449 req-8c420c40-f268-44b4-b448-140260c19824 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Refreshing instance network info cache due to event network-changed-fd6ee6af-3cd0-49a2-b152-25c356a674c2. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0a59f468-7a4c-4300-8624-f06e5f919449 req-8c420c40-f268-44b4-b448-140260c19824 service nova] Acquiring lock "refresh_cache-88dd9488-e777-4b33-9702-e8f0353a62c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Updating instance_info_cache with network_info: [{"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Releasing lock "refresh_cache-88dd9488-e777-4b33-9702-e8f0353a62c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Instance network_info: |[{"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0a59f468-7a4c-4300-8624-f06e5f919449 req-8c420c40-f268-44b4-b448-140260c19824 service nova] Acquired lock "refresh_cache-88dd9488-e777-4b33-9702-e8f0353a62c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.network.neutron [req-0a59f468-7a4c-4300-8624-f06e5f919449 req-8c420c40-f268-44b4-b448-140260c19824 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Refreshing network info cache for port fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Start _get_guest_xml network_info=[{"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:43:29 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:29 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:43:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469363056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469363056',id=25,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-z67mbit9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:43:27Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=88dd9488-e777-4b33-9702-e8f0353a62c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:3c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fd6ee6af-3cd0-49a2-b152-25c356a674c2,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd6ee6af-3c') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'pci_devices' on Instance uuid 88dd9488-e777-4b33-9702-e8f0353a62c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:43:29 user nova-compute[76442]:   <uuid>88dd9488-e777-4b33-9702-e8f0353a62c6</uuid>
Nov 14 20:43:29 user nova-compute[76442]:   <name>instance-00000019</name>
Nov 14 20:43:29 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:43:29 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:43:29 user nova-compute[76442]:   <metadata>
Nov 14 20:43:29 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:43:29 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:43:29 user nova-compute[76442]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1469363056</nova:name>
Nov 14 20:43:29 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:43:29</nova:creationTime>
Nov 14 20:43:29 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:43:29 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:43:29 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:43:29 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:43:29 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:43:29 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:43:29 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:43:29 user nova-compute[76442]:       <nova:owner>
Nov 14 20:43:29 user nova-compute[76442]:         <nova:user uuid="4163211b006c4fbbbdc575c0e6d02ac8">tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member</nova:user>
Nov 14 20:43:29 user nova-compute[76442]:         <nova:project uuid="f83568ed733848d09643843927ca0c42">tempest-ServerBootFromVolumeStableRescueTest-1547619353</nova:project>
Nov 14 20:43:29 user nova-compute[76442]:       </nova:owner>
Nov 14 20:43:29 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:43:29 user nova-compute[76442]:       <nova:ports>
Nov 14 20:43:29 user nova-compute[76442]:         <nova:port uuid="fd6ee6af-3cd0-49a2-b152-25c356a674c2">
Nov 14 20:43:29 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:43:29 user nova-compute[76442]:         </nova:port>
Nov 14 20:43:29 user nova-compute[76442]:       </nova:ports>
Nov 14 20:43:29 user nova-compute[76442]:     </nova:instance>
Nov 14 20:43:29 user nova-compute[76442]:   </metadata>
Nov 14 20:43:29 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:43:29 user nova-compute[76442]:     <system>
Nov 14 20:43:29 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:43:29 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:43:29 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:43:29 user nova-compute[76442]:       <entry name="serial">88dd9488-e777-4b33-9702-e8f0353a62c6</entry>
Nov 14 20:43:29 user nova-compute[76442]:       <entry name="uuid">88dd9488-e777-4b33-9702-e8f0353a62c6</entry>
Nov 14 20:43:29 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:43:29 user nova-compute[76442]:     </system>
Nov 14 20:43:29 user nova-compute[76442]:   </sysinfo>
Nov 14 20:43:29 user nova-compute[76442]:   <os>
Nov 14 20:43:29 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:43:29 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:43:29 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:43:29 user nova-compute[76442]:   </os>
Nov 14 20:43:29 user nova-compute[76442]:   <features>
Nov 14 20:43:29 user nova-compute[76442]:     <acpi/>
Nov 14 20:43:29 user nova-compute[76442]:     <apic/>
Nov 14 20:43:29 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:43:29 user nova-compute[76442]:   </features>
Nov 14 20:43:29 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:43:29 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:43:29 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:43:29 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:43:29 user nova-compute[76442]:   </clock>
Nov 14 20:43:29 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:43:29 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:43:29 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:43:29 user nova-compute[76442]:   </cpu>
Nov 14 20:43:29 user nova-compute[76442]:   <devices>
Nov 14 20:43:29 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:43:29 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:43:29 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk"/>
Nov 14 20:43:29 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:43:29 user nova-compute[76442]:     </disk>
Nov 14 20:43:29 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:43:29 user nova-compute[76442]:       <mac address="fa:16:3e:45:3c:e5"/>
Nov 14 20:43:29 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:43:29 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:43:29 user nova-compute[76442]:       <target dev="tapfd6ee6af-3c"/>
Nov 14 20:43:29 user nova-compute[76442]:     </interface>
Nov 14 20:43:29 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:43:29 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/console.log" append="off"/>
Nov 14 20:43:29 user nova-compute[76442]:     </serial>
Nov 14 20:43:29 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:43:29 user nova-compute[76442]:     <video>
Nov 14 20:43:29 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:43:29 user nova-compute[76442]:     </video>
Nov 14 20:43:29 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:43:29 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:43:29 user nova-compute[76442]:     </rng>
Nov 14 20:43:29 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:43:29 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:43:29 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:43:29 user nova-compute[76442]:     </memballoon>
Nov 14 20:43:29 user nova-compute[76442]:   </devices>
Nov 14 20:43:29 user nova-compute[76442]: </domain>
Nov 14 20:43:29 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:43:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469363056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469363056',id=25,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-z67mbit9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:43:27Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=88dd9488-e777-4b33-9702-e8f0353a62c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:3c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fd6ee6af-3cd0-49a2-b152-25c356a674c2,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd6ee6af-3c') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG os_vif [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fd6ee6af-3cd0-49a2-b152-25c356a674c2,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd6ee6af-3c') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0c29915-bdd2-587e-81dc-9a0839a5888c', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd6ee6af-3c, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd6ee6af-3c, col_values=(('qos', UUID('a2c6fd78-5ad9-4772-a139-77d69efa3ac8')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd6ee6af-3c, col_values=(('external_ids', {'iface-id': 'fd6ee6af-3cd0-49a2-b152-25c356a674c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:3c:e5', 'vm-uuid': '88dd9488-e777-4b33-9702-e8f0353a62c6'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:29 user nova-compute[76442]: INFO os_vif [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fd6ee6af-3cd0-49a2-b152-25c356a674c2,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd6ee6af-3c')
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:43:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No VIF found with MAC fa:16:3e:45:3c:e5, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:43:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:30 user nova-compute[76442]: DEBUG nova.network.neutron [req-0a59f468-7a4c-4300-8624-f06e5f919449 req-8c420c40-f268-44b4-b448-140260c19824 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Updated VIF entry in instance network info cache for port fd6ee6af-3cd0-49a2-b152-25c356a674c2. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:43:30 user nova-compute[76442]: DEBUG nova.network.neutron [req-0a59f468-7a4c-4300-8624-f06e5f919449 req-8c420c40-f268-44b4-b448-140260c19824 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Updating instance_info_cache with network_info: [{"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0a59f468-7a4c-4300-8624-f06e5f919449 req-8c420c40-f268-44b4-b448-140260c19824 service nova] Releasing lock "refresh_cache-88dd9488-e777-4b33-9702-e8f0353a62c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-3c091556-0dbd-48b1-9d99-4cca15af2486 req-6b8f3b13-0f28-4200-9986-26d8311a3f52 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received event network-vif-plugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3c091556-0dbd-48b1-9d99-4cca15af2486 req-6b8f3b13-0f28-4200-9986-26d8311a3f52 service nova] Acquiring lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3c091556-0dbd-48b1-9d99-4cca15af2486 req-6b8f3b13-0f28-4200-9986-26d8311a3f52 service nova] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3c091556-0dbd-48b1-9d99-4cca15af2486 req-6b8f3b13-0f28-4200-9986-26d8311a3f52 service nova] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-3c091556-0dbd-48b1-9d99-4cca15af2486 req-6b8f3b13-0f28-4200-9986-26d8311a3f52 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] No waiting events found dispatching network-vif-plugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:31 user nova-compute[76442]: WARNING nova.compute.manager [req-3c091556-0dbd-48b1-9d99-4cca15af2486 req-6b8f3b13-0f28-4200-9986-26d8311a3f52 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received unexpected event network-vif-plugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 for instance with vm_state building and task_state spawning.
Nov 14 20:43:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:43:33 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Instance spawned successfully.
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:33 user nova-compute[76442]: INFO nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received event network-vif-plugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] Acquiring lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] No waiting events found dispatching network-vif-plugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:33 user nova-compute[76442]: WARNING nova.compute.manager [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received unexpected event network-vif-plugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 for instance with vm_state building and task_state spawning.
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received event network-changed-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Refreshing instance network info cache due to event network-changed-ad752cd2-4691-4d90-bb08-ccbfe1e7795c. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] Acquiring lock "refresh_cache-a48740e3-01af-4599-91d9-8715bc3f8b3e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] Acquired lock "refresh_cache-a48740e3-01af-4599-91d9-8715bc3f8b3e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:43:33 user nova-compute[76442]: DEBUG nova.network.neutron [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Refreshing network info cache for port ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:43:33 user nova-compute[76442]: INFO nova.compute.manager [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Took 6.99 seconds to build instance.
Nov 14 20:43:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e091d6aa-f945-40b5-9a5f-44754ce691ce tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.087s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:34 user nova-compute[76442]: DEBUG nova.network.neutron [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Updated VIF entry in instance network info cache for port ad752cd2-4691-4d90-bb08-ccbfe1e7795c. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:43:34 user nova-compute[76442]: DEBUG nova.network.neutron [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Updating instance_info_cache with network_info: [{"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9f65320a-02c5-403f-968c-e149a4ba7d21 req-024ddcb1-693b-42c3-bdfe-f62bfcbb3097 service nova] Releasing lock "refresh_cache-a48740e3-01af-4599-91d9-8715bc3f8b3e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:43:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:34 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'flavor' on Instance uuid a48740e3-01af-4599-91d9-8715bc3f8b3e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:35 user nova-compute[76442]: INFO nova.compute.manager [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Attaching volume b803f44d-9544-49e7-bdaa-eb8b3a573b38 to /dev/vdb
Nov 14 20:43:35 user nova-compute[76442]: DEBUG os_brick.utils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca3d031-885d-43d9-b4af-14f78e1a344d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f74be2f-ee08-421f-99c0-80a683593302]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ba9a81-c961-4d1e-a5c7-d3e696209c43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c38b77-73a5-4f67-bb6d-58ce2fa88236]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:43:35 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:43:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1054386e-ec21-4ab7-8bc1-de9c88314877]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG os_brick.utils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:43:35 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Updating existing volume attachment record: e1b94cd9-b9ed-4190-ab02-c39cdf287e9e {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:43:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquiring lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:38 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:43:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:38 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:43:38 user nova-compute[76442]: INFO nova.compute.claims [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Claim successful on node user
Nov 14 20:43:39 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:43:39 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:43:39 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:43:39 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Creating image(s)
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquiring lock "/opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "/opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "/opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG nova.policy [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6e5d8cd70a34f348b68641e2fa4cf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b6b371aa054b7689bd3202c001a209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk 1073741824" returned: 0 in 0.052s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Successfully created port: 0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.219s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCOytgDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:43:40 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:43:40 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:43:40 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfffc512-35a2-4238-b3a4-a742578ccd4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:43:40 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfa777b-751a-4b6f-92c1-685f03c72bc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38] added
Nov 14 20:43:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02bce0f-4384-49a1-bed8-1c48f6e801c4]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d615670-52d2-4857-952f-ee8803e37e52]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCOytgDI {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Cannot resize image /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Ensure instance console log exists: /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCOytgDI" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[375a3676-8fd5-426a-9d24-04a7c8299b0d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rCOytgDI'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63fbc21-c242-4a29-8e60-b3f6446c758e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c22318-117e-44a7-9cab-254b7d04b5ee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:43:40 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:43:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:43:40 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:43:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[397ecc70-4163-4958-821f-b8b61d65ce55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38, portal: 172.16.0.220,3260]
Nov 14 20:43:40 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38, portal: 172.16.0.220,3260] successful.
Nov 14 20:43:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3f3f1a-f88a-4d0a-b8d5-e519a55d24ca]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[013ef1d6-ae97-467f-bb9c-dee7767cb047]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:43:40 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:43:40 user nova-compute[76442]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 (non-flash)
Nov 14 20:43:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:43:40 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:43:40 user nova-compute[76442]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 (non-flash)
Nov 14 20:43:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[966f1b0d-2aef-4806-bcd8-f5fbbe8ac524]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCOytgDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Successfully updated port: 0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquiring lock "refresh_cache-0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquired lock "refresh_cache-0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-bc56eec2-4270-437c-a64c-2738793f7bb2 req-08073175-ff6e-4e3d-b83e-9794347cbf8d service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received event network-changed-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-bc56eec2-4270-437c-a64c-2738793f7bb2 req-08073175-ff6e-4e3d-b83e-9794347cbf8d service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Refreshing instance network info cache due to event network-changed-0f69e4e9-39f7-435f-8c92-f9400dd61b8c. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bc56eec2-4270-437c-a64c-2738793f7bb2 req-08073175-ff6e-4e3d-b83e-9794347cbf8d service nova] Acquiring lock "refresh_cache-0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:43:40 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Updating instance_info_cache with network_info: [{"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Releasing lock "refresh_cache-0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Instance network_info: |[{"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bc56eec2-4270-437c-a64c-2738793f7bb2 req-08073175-ff6e-4e3d-b83e-9794347cbf8d service nova] Acquired lock "refresh_cache-0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.network.neutron [req-bc56eec2-4270-437c-a64c-2738793f7bb2 req-08073175-ff6e-4e3d-b83e-9794347cbf8d service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Refreshing network info cache for port 0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Start _get_guest_xml network_info=[{"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:43:41 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:41 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-731217489',display_name='tempest-VolumesActionsTest-instance-731217489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-731217489',id=26,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b6b371aa054b7689bd3202c001a209',ramdisk_id='',reservation_id='r-lknkxej0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1366029594',owner_user_name='tempest-VolumesActionsTest-1366029594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:43:40Z,user_data=None,user_id='d6e5d8cd70a34f348b68641e2fa4cf74',uuid=0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Converting VIF {"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:69,bridge_name='br-int',has_traffic_filtering=True,id=0f69e4e9-39f7-435f-8c92-f9400dd61b8c,network=Network(820534ae-628c-414c-9019-17864776bd57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f69e4e9-39') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.objects.instance [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lazy-loading 'pci_devices' on Instance uuid 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:43:41 user nova-compute[76442]:   <uuid>0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64</uuid>
Nov 14 20:43:41 user nova-compute[76442]:   <name>instance-0000001a</name>
Nov 14 20:43:41 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:43:41 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:43:41 user nova-compute[76442]:   <metadata>
Nov 14 20:43:41 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:43:41 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:43:41 user nova-compute[76442]:       <nova:name>tempest-VolumesActionsTest-instance-731217489</nova:name>
Nov 14 20:43:41 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:43:41</nova:creationTime>
Nov 14 20:43:41 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:43:41 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:43:41 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:43:41 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:43:41 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:43:41 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:43:41 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:43:41 user nova-compute[76442]:       <nova:owner>
Nov 14 20:43:41 user nova-compute[76442]:         <nova:user uuid="d6e5d8cd70a34f348b68641e2fa4cf74">tempest-VolumesActionsTest-1366029594-project-member</nova:user>
Nov 14 20:43:41 user nova-compute[76442]:         <nova:project uuid="88b6b371aa054b7689bd3202c001a209">tempest-VolumesActionsTest-1366029594</nova:project>
Nov 14 20:43:41 user nova-compute[76442]:       </nova:owner>
Nov 14 20:43:41 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:43:41 user nova-compute[76442]:       <nova:ports>
Nov 14 20:43:41 user nova-compute[76442]:         <nova:port uuid="0f69e4e9-39f7-435f-8c92-f9400dd61b8c">
Nov 14 20:43:41 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:43:41 user nova-compute[76442]:         </nova:port>
Nov 14 20:43:41 user nova-compute[76442]:       </nova:ports>
Nov 14 20:43:41 user nova-compute[76442]:     </nova:instance>
Nov 14 20:43:41 user nova-compute[76442]:   </metadata>
Nov 14 20:43:41 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:43:41 user nova-compute[76442]:     <system>
Nov 14 20:43:41 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:43:41 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:43:41 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:43:41 user nova-compute[76442]:       <entry name="serial">0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64</entry>
Nov 14 20:43:41 user nova-compute[76442]:       <entry name="uuid">0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64</entry>
Nov 14 20:43:41 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:43:41 user nova-compute[76442]:     </system>
Nov 14 20:43:41 user nova-compute[76442]:   </sysinfo>
Nov 14 20:43:41 user nova-compute[76442]:   <os>
Nov 14 20:43:41 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:43:41 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:43:41 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:43:41 user nova-compute[76442]:   </os>
Nov 14 20:43:41 user nova-compute[76442]:   <features>
Nov 14 20:43:41 user nova-compute[76442]:     <acpi/>
Nov 14 20:43:41 user nova-compute[76442]:     <apic/>
Nov 14 20:43:41 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:43:41 user nova-compute[76442]:   </features>
Nov 14 20:43:41 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:43:41 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:43:41 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:43:41 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:43:41 user nova-compute[76442]:   </clock>
Nov 14 20:43:41 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:43:41 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:43:41 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:43:41 user nova-compute[76442]:   </cpu>
Nov 14 20:43:41 user nova-compute[76442]:   <devices>
Nov 14 20:43:41 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:43:41 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:43:41 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk"/>
Nov 14 20:43:41 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:43:41 user nova-compute[76442]:     </disk>
Nov 14 20:43:41 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:43:41 user nova-compute[76442]:       <mac address="fa:16:3e:b1:35:69"/>
Nov 14 20:43:41 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:43:41 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:43:41 user nova-compute[76442]:       <target dev="tap0f69e4e9-39"/>
Nov 14 20:43:41 user nova-compute[76442]:     </interface>
Nov 14 20:43:41 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:43:41 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/console.log" append="off"/>
Nov 14 20:43:41 user nova-compute[76442]:     </serial>
Nov 14 20:43:41 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:43:41 user nova-compute[76442]:     <video>
Nov 14 20:43:41 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:43:41 user nova-compute[76442]:     </video>
Nov 14 20:43:41 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:43:41 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:43:41 user nova-compute[76442]:     </rng>
Nov 14 20:43:41 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:43:41 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:43:41 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:43:41 user nova-compute[76442]:     </memballoon>
Nov 14 20:43:41 user nova-compute[76442]:   </devices>
Nov 14 20:43:41 user nova-compute[76442]: </domain>
Nov 14 20:43:41 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-731217489',display_name='tempest-VolumesActionsTest-instance-731217489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-731217489',id=26,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b6b371aa054b7689bd3202c001a209',ramdisk_id='',reservation_id='r-lknkxej0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1366029594',owner_user_name='tempest-VolumesActionsTest-1366029594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:43:40Z,user_data=None,user_id='d6e5d8cd70a34f348b68641e2fa4cf74',uuid=0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Converting VIF {"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:69,bridge_name='br-int',has_traffic_filtering=True,id=0f69e4e9-39f7-435f-8c92-f9400dd61b8c,network=Network(820534ae-628c-414c-9019-17864776bd57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f69e4e9-39') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG os_vif [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:69,bridge_name='br-int',has_traffic_filtering=True,id=0f69e4e9-39f7-435f-8c92-f9400dd61b8c,network=Network(820534ae-628c-414c-9019-17864776bd57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f69e4e9-39') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bea2f4e8-46ac-5fcc-8d6b-f1cb22fce163', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f69e4e9-39, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f69e4e9-39, col_values=(('qos', UUID('81b263d6-d177-4cdc-8cab-970df65cbdff')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f69e4e9-39, col_values=(('external_ids', {'iface-id': '0f69e4e9-39f7-435f-8c92-f9400dd61b8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:35:69', 'vm-uuid': '0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:41 user nova-compute[76442]: INFO os_vif [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:69,bridge_name='br-int',has_traffic_filtering=True,id=0f69e4e9-39f7-435f-8c92-f9400dd61b8c,network=Network(820534ae-628c-414c-9019-17864776bd57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f69e4e9-39')
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] No VIF found with MAC fa:16:3e:b1:35:69, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.network.neutron [req-bc56eec2-4270-437c-a64c-2738793f7bb2 req-08073175-ff6e-4e3d-b83e-9794347cbf8d service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Updated VIF entry in instance network info cache for port 0f69e4e9-39f7-435f-8c92-f9400dd61b8c. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.network.neutron [req-bc56eec2-4270-437c-a64c-2738793f7bb2 req-08073175-ff6e-4e3d-b83e-9794347cbf8d service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Updating instance_info_cache with network_info: [{"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bc56eec2-4270-437c-a64c-2738793f7bb2 req-08073175-ff6e-4e3d-b83e-9794347cbf8d service nova] Releasing lock "refresh_cache-0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26165386238396632', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165386238396632', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'flavor' on Instance uuid a48740e3-01af-4599-91d9-8715bc3f8b3e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:43:41 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:43:41 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:43:41 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:43:41 user nova-compute[76442]:   <serial>b803f44d-9544-49e7-bdaa-eb8b3a573b38</serial>
Nov 14 20:43:41 user nova-compute[76442]: </disk>
Nov 14 20:43:41 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:43:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:43:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:43:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No VIF found with MAC fa:16:3e:ba:87:39, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:43:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ae2a3ed-8aac-44ee-aafe-c21f1baf8024 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.570s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-3aff324c-df47-4d9d-b394-13391fb3656e req-3fa63f99-3dc3-4160-a003-afa84294ae9c service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received event network-vif-plugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3aff324c-df47-4d9d-b394-13391fb3656e req-3fa63f99-3dc3-4160-a003-afa84294ae9c service nova] Acquiring lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3aff324c-df47-4d9d-b394-13391fb3656e req-3fa63f99-3dc3-4160-a003-afa84294ae9c service nova] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3aff324c-df47-4d9d-b394-13391fb3656e req-3fa63f99-3dc3-4160-a003-afa84294ae9c service nova] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-3aff324c-df47-4d9d-b394-13391fb3656e req-3fa63f99-3dc3-4160-a003-afa84294ae9c service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] No waiting events found dispatching network-vif-plugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:43 user nova-compute[76442]: WARNING nova.compute.manager [req-3aff324c-df47-4d9d-b394-13391fb3656e req-3fa63f99-3dc3-4160-a003-afa84294ae9c service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received unexpected event network-vif-plugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c for instance with vm_state building and task_state spawning.
Nov 14 20:43:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:44 user nova-compute[76442]: INFO nova.compute.manager [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Detaching volume b803f44d-9544-49e7-bdaa-eb8b3a573b38
Nov 14 20:43:44 user nova-compute[76442]: INFO nova.virt.block_device [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Attempting to driver detach volume b803f44d-9544-49e7-bdaa-eb8b3a573b38 from mountpoint /dev/vdb
Nov 14 20:43:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Attempting to detach device vdb from instance a48740e3-01af-4599-91d9-8715bc3f8b3e from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:43:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:43:44 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:43:44 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:43:44 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:43:44 user nova-compute[76442]:   <serial>b803f44d-9544-49e7-bdaa-eb8b3a573b38</serial>
Nov 14 20:43:44 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:43:44 user nova-compute[76442]: </disk>
Nov 14 20:43:44 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:43:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully detached device vdb from instance a48740e3-01af-4599-91d9-8715bc3f8b3e from the persistent domain config.
Nov 14 20:43:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a48740e3-01af-4599-91d9-8715bc3f8b3e from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:43:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:43:44 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:43:44 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:43:44 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:43:44 user nova-compute[76442]:   <serial>b803f44d-9544-49e7-bdaa-eb8b3a573b38</serial>
Nov 14 20:43:44 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:43:44 user nova-compute[76442]: </disk>
Nov 14 20:43:44 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:43:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a48740e3-01af-4599-91d9-8715bc3f8b3e {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:43:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Instance spawned successfully.
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-34bb6a3f-588e-4df7-8a70-b26ab900b99c req-1cc57058-c895-448b-8caa-0a3d07a59724 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received event network-vif-plugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-34bb6a3f-588e-4df7-8a70-b26ab900b99c req-1cc57058-c895-448b-8caa-0a3d07a59724 service nova] Acquiring lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-34bb6a3f-588e-4df7-8a70-b26ab900b99c req-1cc57058-c895-448b-8caa-0a3d07a59724 service nova] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-34bb6a3f-588e-4df7-8a70-b26ab900b99c req-1cc57058-c895-448b-8caa-0a3d07a59724 service nova] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-34bb6a3f-588e-4df7-8a70-b26ab900b99c req-1cc57058-c895-448b-8caa-0a3d07a59724 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] No waiting events found dispatching network-vif-plugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:45 user nova-compute[76442]: WARNING nova.compute.manager [req-34bb6a3f-588e-4df7-8a70-b26ab900b99c req-1cc57058-c895-448b-8caa-0a3d07a59724 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received unexpected event network-vif-plugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c for instance with vm_state building and task_state spawning.
Nov 14 20:43:45 user nova-compute[76442]: INFO nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 14 20:43:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:43:45 user nova-compute[76442]: INFO nova.compute.manager [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Took 6.64 seconds to build instance.
Nov 14 20:43:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf08e61e-e5c3-4105-a8fd-46275960900a tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.738s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:43:47 user nova-compute[76442]: INFO nova.compute.claims [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Claim successful on node user
Nov 14 20:43:47 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:43:47 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:43:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:43:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG nova.policy [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b873835b5e341c5aebfd4ded5f2c093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265a9c8786db48c78145d1388a5c321f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:43:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Creating image(s)
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk 1073741824" returned: 0 in 0.054s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Successfully created port: a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Cannot resize image /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Ensure instance console log exists: /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Successfully updated port: a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "refresh_cache-447a1211-ebb6-4b4e-9207-047312e59f82" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquired lock "refresh_cache-447a1211-ebb6-4b4e-9207-047312e59f82" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-d500cf6d-47dc-49e6-8bdc-3c9d0c32fd47 req-a52ca259-4abf-4dc4-ada4-d449ed7700dd service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-changed-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-d500cf6d-47dc-49e6-8bdc-3c9d0c32fd47 req-a52ca259-4abf-4dc4-ada4-d449ed7700dd service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Refreshing instance network info cache due to event network-changed-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d500cf6d-47dc-49e6-8bdc-3c9d0c32fd47 req-a52ca259-4abf-4dc4-ada4-d449ed7700dd service nova] Acquiring lock "refresh_cache-447a1211-ebb6-4b4e-9207-047312e59f82" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Updating instance_info_cache with network_info: [{"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Releasing lock "refresh_cache-447a1211-ebb6-4b4e-9207-047312e59f82" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Instance network_info: |[{"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d500cf6d-47dc-49e6-8bdc-3c9d0c32fd47 req-a52ca259-4abf-4dc4-ada4-d449ed7700dd service nova] Acquired lock "refresh_cache-447a1211-ebb6-4b4e-9207-047312e59f82" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.network.neutron [req-d500cf6d-47dc-49e6-8bdc-3c9d0c32fd47 req-a52ca259-4abf-4dc4-ada4-d449ed7700dd service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Refreshing network info cache for port a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Start _get_guest_xml network_info=[{"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:43:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-499867076',display_name='tempest-tempest.common.compute-instance-499867076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-499867076',id=27,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhvsEZC0bcnfS2UzsdizcTnu8K63xeTSWXSenE88qW4P2SVk+A6XJuerbfkhGBUpnBKQwDTJWQX3TBjWO9boLSj04YxQKsAqQ5X4QfVYbLp9D569QPjJG8Agn490Q7bnw==',key_name='tempest-keypair-1495363036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-caelltby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=447a1211-ebb6-4b4e-9207-047312e59f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'pci_devices' on Instance uuid 447a1211-ebb6-4b4e-9207-047312e59f82 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:43:49 user nova-compute[76442]:   <uuid>447a1211-ebb6-4b4e-9207-047312e59f82</uuid>
Nov 14 20:43:49 user nova-compute[76442]:   <name>instance-0000001b</name>
Nov 14 20:43:49 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:43:49 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:43:49 user nova-compute[76442]:   <metadata>
Nov 14 20:43:49 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:43:49 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:43:49 user nova-compute[76442]:       <nova:name>tempest-tempest.common.compute-instance-499867076</nova:name>
Nov 14 20:43:49 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:43:49</nova:creationTime>
Nov 14 20:43:49 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:43:49 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:43:49 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:43:49 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:43:49 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:43:49 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:43:49 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:43:49 user nova-compute[76442]:       <nova:owner>
Nov 14 20:43:49 user nova-compute[76442]:         <nova:user uuid="3b873835b5e341c5aebfd4ded5f2c093">tempest-ServerActionsTestOtherA-887472165-project-member</nova:user>
Nov 14 20:43:49 user nova-compute[76442]:         <nova:project uuid="265a9c8786db48c78145d1388a5c321f">tempest-ServerActionsTestOtherA-887472165</nova:project>
Nov 14 20:43:49 user nova-compute[76442]:       </nova:owner>
Nov 14 20:43:49 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:43:49 user nova-compute[76442]:       <nova:ports>
Nov 14 20:43:49 user nova-compute[76442]:         <nova:port uuid="a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7">
Nov 14 20:43:49 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:43:49 user nova-compute[76442]:         </nova:port>
Nov 14 20:43:49 user nova-compute[76442]:       </nova:ports>
Nov 14 20:43:49 user nova-compute[76442]:     </nova:instance>
Nov 14 20:43:49 user nova-compute[76442]:   </metadata>
Nov 14 20:43:49 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:43:49 user nova-compute[76442]:     <system>
Nov 14 20:43:49 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:43:49 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:43:49 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:43:49 user nova-compute[76442]:       <entry name="serial">447a1211-ebb6-4b4e-9207-047312e59f82</entry>
Nov 14 20:43:49 user nova-compute[76442]:       <entry name="uuid">447a1211-ebb6-4b4e-9207-047312e59f82</entry>
Nov 14 20:43:49 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:43:49 user nova-compute[76442]:     </system>
Nov 14 20:43:49 user nova-compute[76442]:   </sysinfo>
Nov 14 20:43:49 user nova-compute[76442]:   <os>
Nov 14 20:43:49 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:43:49 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:43:49 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:43:49 user nova-compute[76442]:   </os>
Nov 14 20:43:49 user nova-compute[76442]:   <features>
Nov 14 20:43:49 user nova-compute[76442]:     <acpi/>
Nov 14 20:43:49 user nova-compute[76442]:     <apic/>
Nov 14 20:43:49 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:43:49 user nova-compute[76442]:   </features>
Nov 14 20:43:49 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:43:49 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:43:49 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:43:49 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:43:49 user nova-compute[76442]:   </clock>
Nov 14 20:43:49 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:43:49 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:43:49 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:43:49 user nova-compute[76442]:   </cpu>
Nov 14 20:43:49 user nova-compute[76442]:   <devices>
Nov 14 20:43:49 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:43:49 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:43:49 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk"/>
Nov 14 20:43:49 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:43:49 user nova-compute[76442]:     </disk>
Nov 14 20:43:49 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:43:49 user nova-compute[76442]:       <mac address="fa:16:3e:f5:74:f7"/>
Nov 14 20:43:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:43:49 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:43:49 user nova-compute[76442]:       <target dev="tapa883b6df-bc"/>
Nov 14 20:43:49 user nova-compute[76442]:     </interface>
Nov 14 20:43:49 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:43:49 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/console.log" append="off"/>
Nov 14 20:43:49 user nova-compute[76442]:     </serial>
Nov 14 20:43:49 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:43:49 user nova-compute[76442]:     <video>
Nov 14 20:43:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:43:49 user nova-compute[76442]:     </video>
Nov 14 20:43:49 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:43:49 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:43:49 user nova-compute[76442]:     </rng>
Nov 14 20:43:49 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:43:49 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:43:49 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:43:49 user nova-compute[76442]:     </memballoon>
Nov 14 20:43:49 user nova-compute[76442]:   </devices>
Nov 14 20:43:49 user nova-compute[76442]: </domain>
Nov 14 20:43:49 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-499867076',display_name='tempest-tempest.common.compute-instance-499867076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-499867076',id=27,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhvsEZC0bcnfS2UzsdizcTnu8K63xeTSWXSenE88qW4P2SVk+A6XJuerbfkhGBUpnBKQwDTJWQX3TBjWO9boLSj04YxQKsAqQ5X4QfVYbLp9D569QPjJG8Agn490Q7bnw==',key_name='tempest-keypair-1495363036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-caelltby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=447a1211-ebb6-4b4e-9207-047312e59f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG os_vif [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '432bfc24-ff31-506a-a6de-d8482f70f3e3', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa883b6df-bc, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa883b6df-bc, col_values=(('qos', UUID('a15748f4-aff7-4811-a140-7a559191f8ef')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa883b6df-bc, col_values=(('external_ids', {'iface-id': 'a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:74:f7', 'vm-uuid': '447a1211-ebb6-4b4e-9207-047312e59f82'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:49 user nova-compute[76442]: INFO os_vif [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc')
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:43:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No VIF found with MAC fa:16:3e:f5:74:f7, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:43:50 user nova-compute[76442]: DEBUG nova.network.neutron [req-d500cf6d-47dc-49e6-8bdc-3c9d0c32fd47 req-a52ca259-4abf-4dc4-ada4-d449ed7700dd service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Updated VIF entry in instance network info cache for port a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:43:50 user nova-compute[76442]: DEBUG nova.network.neutron [req-d500cf6d-47dc-49e6-8bdc-3c9d0c32fd47 req-a52ca259-4abf-4dc4-ada4-d449ed7700dd service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Updating instance_info_cache with network_info: [{"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:43:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d500cf6d-47dc-49e6-8bdc-3c9d0c32fd47 req-a52ca259-4abf-4dc4-ada4-d449ed7700dd service nova] Releasing lock "refresh_cache-447a1211-ebb6-4b4e-9207-047312e59f82" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-1a89ee7e-329e-47ad-a542-70fa7a83fd67 req-56213306-ce73-466e-8bba-b1c3448d596a service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1a89ee7e-329e-47ad-a542-70fa7a83fd67 req-56213306-ce73-466e-8bba-b1c3448d596a service nova] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1a89ee7e-329e-47ad-a542-70fa7a83fd67 req-56213306-ce73-466e-8bba-b1c3448d596a service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1a89ee7e-329e-47ad-a542-70fa7a83fd67 req-56213306-ce73-466e-8bba-b1c3448d596a service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-1a89ee7e-329e-47ad-a542-70fa7a83fd67 req-56213306-ce73-466e-8bba-b1c3448d596a service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] No waiting events found dispatching network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:51 user nova-compute[76442]: WARNING nova.compute.manager [req-1a89ee7e-329e-47ad-a542-70fa7a83fd67 req-56213306-ce73-466e-8bba-b1c3448d596a service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received unexpected event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 for instance with vm_state building and task_state spawning.
Nov 14 20:43:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:43:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Instance spawned successfully.
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:43:53 user nova-compute[76442]: INFO nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:43:53 user nova-compute[76442]: INFO nova.compute.manager [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Took 6.29 seconds to build instance.
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-2417dc25-1261-42c6-8e2e-f9e0f53b7fae req-bb8a15ce-1e59-460b-8ca2-635a6c8b9d0d service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2417dc25-1261-42c6-8e2e-f9e0f53b7fae req-bb8a15ce-1e59-460b-8ca2-635a6c8b9d0d service nova] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2417dc25-1261-42c6-8e2e-f9e0f53b7fae req-bb8a15ce-1e59-460b-8ca2-635a6c8b9d0d service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2417dc25-1261-42c6-8e2e-f9e0f53b7fae req-bb8a15ce-1e59-460b-8ca2-635a6c8b9d0d service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-2417dc25-1261-42c6-8e2e-f9e0f53b7fae req-bb8a15ce-1e59-460b-8ca2-635a6c8b9d0d service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] No waiting events found dispatching network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:43:53 user nova-compute[76442]: WARNING nova.compute.manager [req-2417dc25-1261-42c6-8e2e-f9e0f53b7fae req-bb8a15ce-1e59-460b-8ca2-635a6c8b9d0d service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received unexpected event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 for instance with vm_state active and task_state None.
Nov 14 20:43:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f76c94f5-bfb2-44db-96bf-3cccd1eabebd tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.406s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:43:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:43:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:43:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:00 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:44:00 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:44:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:02 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:44:02 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:44:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:44:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-10ab529b-670c-440a-98ce-c0a0cbd38842 req-3e8658e7-7ef2-477a-8605-8b25b587993d service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-changed-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-10ab529b-670c-440a-98ce-c0a0cbd38842 req-3e8658e7-7ef2-477a-8605-8b25b587993d service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Refreshing instance network info cache due to event network-changed-9d5ec5ad-760e-438c-9e3b-b178e43f9e98. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-10ab529b-670c-440a-98ce-c0a0cbd38842 req-3e8658e7-7ef2-477a-8605-8b25b587993d service nova] Acquiring lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-10ab529b-670c-440a-98ce-c0a0cbd38842 req-3e8658e7-7ef2-477a-8605-8b25b587993d service nova] Acquired lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG nova.network.neutron [req-10ab529b-670c-440a-98ce-c0a0cbd38842 req-3e8658e7-7ef2-477a-8605-8b25b587993d service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Refreshing network info cache for port 9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a48740e3-01af-4599-91d9-8715bc3f8b3e is timed out.
Nov 14 20:44:04 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully detached device vdb from instance a48740e3-01af-4599-91d9-8715bc3f8b3e from the live domain config.
Nov 14 20:44:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCOytgDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:44:04 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9425ea12-a36c-4d93-97b1-52722f401083]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:44:04 user nova-compute[76442]: No targets found.
Nov 14 20:44:04 user nova-compute[76442]: iSNS:
Nov 14 20:44:04 user nova-compute[76442]: No targets found.
Nov 14 20:44:04 user nova-compute[76442]: STATIC:
Nov 14 20:44:04 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38
Nov 14 20:44:04 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:44:04 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:44:04 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f
Nov 14 20:44:04 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:44:04 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:44:04 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:44:04 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:44:04 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:44:04 user nova-compute[76442]: FIRMWARE:
Nov 14 20:44:04 user nova-compute[76442]: No targets found.
Nov 14 20:44:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:44:04 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:44:04 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3277766d-e9ae-43a7-91ba-f94bbd92b95c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG nova.network.neutron [req-10ab529b-670c-440a-98ce-c0a0cbd38842 req-3e8658e7-7ef2-477a-8605-8b25b587993d service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updated VIF entry in instance network info cache for port 9d5ec5ad-760e-438c-9e3b-b178e43f9e98. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG nova.network.neutron [req-10ab529b-670c-440a-98ce-c0a0cbd38842 req-3e8658e7-7ef2-477a-8605-8b25b587993d service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating instance_info_cache with network_info: [{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d72d094-a7f4-490b-8e15-b48348d64c26]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:04 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:44:04 user nova-compute[76442]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 (non-flash)
Nov 14 20:44:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:04 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:44:04 user nova-compute[76442]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 (non-flash)
Nov 14 20:44:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4e04a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-10ab529b-670c-440a-98ce-c0a0cbd38842 req-3e8658e7-7ef2-477a-8605-8b25b587993d service nova] Releasing lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0939b503-9dc1-4204-a19a-f9f75ceb9079]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[173f6878-b31b-4578-b042-3367dd3f4fa9]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36a4c6d-db3a-493c-95fa-fa80c3345fdd]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9016c92-f790-413d-9bf8-1ee74b2fbf8b]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbbe5ca-6b94-4c52-a2d0-251c44c4a588]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0453306a-6359-487a-bc9f-bfe9c90f7191]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38, portal: 172.16.0.220,3260]
Nov 14 20:44:04 user nova-compute[76442]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38, portal: 172.16.0.220,3260] successful.
Nov 14 20:44:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803f44d-9544-49e7-bdaa-eb8b3a573b38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec9c98a-2be5-45ae-9a33-3426fd3e7f5d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] <== disconnect_volume: return (326ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:44:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'flavor' on Instance uuid a48740e3-01af-4599-91d9-8715bc3f8b3e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5a9f7e34-0250-4657-8663-0340f3b5fad4 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.777s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:07 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:44:07 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7275MB free_disk=25.19671630859375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 31c7399a-07f6-40d7-a62c-8fa374193ba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a48740e3-01af-4599-91d9-8715bc3f8b3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2458523e-c461-4cd5-903c-2d7ab0222162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3b28c6e1-5191-48fd-be07-d1af671b0695 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 88dd9488-e777-4b33-9702-e8f0353a62c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 447a1211-ebb6-4b4e-9207-047312e59f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:44:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:44:08 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:44:08 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:44:08 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:44:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updating instance_info_cache with network_info: [{"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:44:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-e839d527-4fce-46c7-b3d9-201b3cb4c0d3 req-8ff0a119-4b24-443d-93fe-10471187d1d0 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-changed-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-e839d527-4fce-46c7-b3d9-201b3cb4c0d3 req-8ff0a119-4b24-443d-93fe-10471187d1d0 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Refreshing instance network info cache due to event network-changed-fb8ed0c1-0dd9-4677-b881-904340c8fbf5. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e839d527-4fce-46c7-b3d9-201b3cb4c0d3 req-8ff0a119-4b24-443d-93fe-10471187d1d0 service nova] Acquiring lock "refresh_cache-3b28c6e1-5191-48fd-be07-d1af671b0695" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e839d527-4fce-46c7-b3d9-201b3cb4c0d3 req-8ff0a119-4b24-443d-93fe-10471187d1d0 service nova] Acquired lock "refresh_cache-3b28c6e1-5191-48fd-be07-d1af671b0695" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG nova.network.neutron [req-e839d527-4fce-46c7-b3d9-201b3cb4c0d3 req-8ff0a119-4b24-443d-93fe-10471187d1d0 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Refreshing network info cache for port fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG nova.network.neutron [req-e839d527-4fce-46c7-b3d9-201b3cb4c0d3 req-8ff0a119-4b24-443d-93fe-10471187d1d0 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Updated VIF entry in instance network info cache for port fb8ed0c1-0dd9-4677-b881-904340c8fbf5. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG nova.network.neutron [req-e839d527-4fce-46c7-b3d9-201b3cb4c0d3 req-8ff0a119-4b24-443d-93fe-10471187d1d0 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Updating instance_info_cache with network_info: [{"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e839d527-4fce-46c7-b3d9-201b3cb4c0d3 req-8ff0a119-4b24-443d-93fe-10471187d1d0 service nova] Releasing lock "refresh_cache-3b28c6e1-5191-48fd-be07-d1af671b0695" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:44:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:30 user nova-compute[76442]: INFO nova.compute.manager [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Rebuilding instance
Nov 14 20:44:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:44:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:30 user nova-compute[76442]: DEBUG nova.compute.manager [req-22905be7-6760-401f-9d98-cc2ebc27e7b2 req-dbbdffaf-232b-4314-b47d-eb2c1a4034fa service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-unplugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-22905be7-6760-401f-9d98-cc2ebc27e7b2 req-dbbdffaf-232b-4314-b47d-eb2c1a4034fa service nova] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-22905be7-6760-401f-9d98-cc2ebc27e7b2 req-dbbdffaf-232b-4314-b47d-eb2c1a4034fa service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-22905be7-6760-401f-9d98-cc2ebc27e7b2 req-dbbdffaf-232b-4314-b47d-eb2c1a4034fa service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:30 user nova-compute[76442]: DEBUG nova.compute.manager [req-22905be7-6760-401f-9d98-cc2ebc27e7b2 req-dbbdffaf-232b-4314-b47d-eb2c1a4034fa service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] No waiting events found dispatching network-vif-unplugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:44:30 user nova-compute[76442]: WARNING nova.compute.manager [req-22905be7-6760-401f-9d98-cc2ebc27e7b2 req-dbbdffaf-232b-4314-b47d-eb2c1a4034fa service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received unexpected event network-vif-unplugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 for instance with vm_state active and task_state rebuilding.
Nov 14 20:44:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance destroyed successfully.
Nov 14 20:44:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance destroyed successfully.
Nov 14 20:44:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-592433099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-45726840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY9gZC8aB/JVqRnz6O+jEJIYx3p8DCBh9I7CmcOwY/m7HTA/XQPaLwT4ucWvMGkpa+45IFG/yxglKz5lQd7V/yRTk6SXIoIm2npdlarA3QE1Y1entI5IU/P4Rc/W1pfyQ==',key_name='tempest-keypair-1596655746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:42:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ce7cf07105a4357920a0e48d02e38f4',ramdisk_id='',reservation_id='r-jexecte0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1273726129',owner_user_name='tempest-ServerActionsV293TestJSON-1273726129-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6972c92678b245978e9692d3a75da62d',uuid=3b28c6e1-5191-48fd-be07-d1af671b0695,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converting VIF {"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_vif [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb8ed0c1-0d, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e992448f-878c-4526-b278-b342586906c0) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:44:31 user nova-compute[76442]: INFO os_vif [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d')
Nov 14 20:44:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRtcSXzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:44:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb9ccc3-50cd-42fd-bda9-4aa0ae97f068]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:44:31 user nova-compute[76442]: No targets found.
Nov 14 20:44:31 user nova-compute[76442]: iSNS:
Nov 14 20:44:31 user nova-compute[76442]: No targets found.
Nov 14 20:44:31 user nova-compute[76442]: STATIC:
Nov 14 20:44:31 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f
Nov 14 20:44:31 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:44:31 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:44:31 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:44:31 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:44:31 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:44:31 user nova-compute[76442]: FIRMWARE:
Nov 14 20:44:31 user nova-compute[76442]: No targets found.
Nov 14 20:44:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:44:31 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:44:31 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42436dc-3dcf-4438-950c-f6664185bad7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e3c41c-3e78-4c18-96a9-057b8d1db409]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:31 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:44:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:31 user nova-compute[76442]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:44:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e84b1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e947b54-3aac-4960-9b8b-6c24d001f213]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[984bfbab-275c-4b1d-8301-92732835f4d9]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4726c3c-5644-4800-8c8f-4b96e1decf0a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[90758af0-3e14-4b1b-8876-49534dd2764c]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9500c64f',) {{(pid=87657) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc5b5e3-bf80-467a-97b8-dae764ee28ec]: (4, None) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[29569378-4ee2-4c9e-9659-0a2c3b3af3bb]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5a3a6f-07a0-4f0f-b033-8918eaadeba8]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260]
Nov 14 20:44:31 user nova-compute[76442]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260] successful.
Nov 14 20:44:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[af941e3d-d31d-43b7-bcb0-79f51ac82809]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] <== disconnect_volume: return (319ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:44:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Deleting instance files /opt/stack/data/nova/instances/3b28c6e1-5191-48fd-be07-d1af671b0695_del
Nov 14 20:44:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Deletion of /opt/stack/data/nova/instances/3b28c6e1-5191-48fd-be07-d1af671b0695_del complete
Nov 14 20:44:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3b28c6e1-5191-48fd-be07-d1af671b0695 could not be found.
Nov 14 20:44:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRtcSXzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:44:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da9fb3-2d5d-4b27-bf27-b3a540229009]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:44:31 user nova-compute[76442]: No targets found.
Nov 14 20:44:31 user nova-compute[76442]: iSNS:
Nov 14 20:44:31 user nova-compute[76442]: No targets found.
Nov 14 20:44:31 user nova-compute[76442]: STATIC:
Nov 14 20:44:31 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:44:31 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:44:31 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:44:31 user nova-compute[76442]: FIRMWARE:
Nov 14 20:44:31 user nova-compute[76442]: No targets found.
Nov 14 20:44:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:44:31 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:44:31 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c9725-5bb4-4ee2-aff7-1b518e50b5e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[12432ccf-c742-40ab-abea-3647d995f0dc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4e6f6d0>, {}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Disconnecting from: [] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] <== disconnect_volume: return (63ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:44:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:32 user nova-compute[76442]: INFO nova.compute.manager [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Rescuing
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquired lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updating instance_info_cache with network_info: [{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Preparing to wait for external event volume-reimaged-69c8788c-116f-4c6d-9a69-e6ebd291f72f {{(pid=76442) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Releasing lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-c43d84a2-feac-44aa-8551-166577091f2d req-adae3af6-c0da-4a7f-a9a9-04584ff13e91 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c43d84a2-feac-44aa-8551-166577091f2d req-adae3af6-c0da-4a7f-a9a9-04584ff13e91 service nova] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c43d84a2-feac-44aa-8551-166577091f2d req-adae3af6-c0da-4a7f-a9a9-04584ff13e91 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c43d84a2-feac-44aa-8551-166577091f2d req-adae3af6-c0da-4a7f-a9a9-04584ff13e91 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-c43d84a2-feac-44aa-8551-166577091f2d req-adae3af6-c0da-4a7f-a9a9-04584ff13e91 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] No event matching network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 in dict_keys([('volume-reimaged', '69c8788c-116f-4c6d-9a69-e6ebd291f72f')]) {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 14 20:44:32 user nova-compute[76442]: WARNING nova.compute.manager [req-c43d84a2-feac-44aa-8551-166577091f2d req-adae3af6-c0da-4a7f-a9a9-04584ff13e91 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received unexpected event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 for instance with vm_state active and task_state rebuilding.
Nov 14 20:44:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-9576f5ab-47d4-499f-8aad-047fd613c7ac req-6260fded-9f3a-4bc2-a85c-0a459d1b8576 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-unplugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9576f5ab-47d4-499f-8aad-047fd613c7ac req-6260fded-9f3a-4bc2-a85c-0a459d1b8576 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9576f5ab-47d4-499f-8aad-047fd613c7ac req-6260fded-9f3a-4bc2-a85c-0a459d1b8576 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9576f5ab-47d4-499f-8aad-047fd613c7ac req-6260fded-9f3a-4bc2-a85c-0a459d1b8576 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-9576f5ab-47d4-499f-8aad-047fd613c7ac req-6260fded-9f3a-4bc2-a85c-0a459d1b8576 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-unplugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:44:32 user nova-compute[76442]: WARNING nova.compute.manager [req-9576f5ab-47d4-499f-8aad-047fd613c7ac req-6260fded-9f3a-4bc2-a85c-0a459d1b8576 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-unplugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state active and task_state rescuing.
Nov 14 20:44:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:33 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Instance destroyed successfully.
Nov 14 20:44:33 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Attempting rescue
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76442) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Instance directory exists: not creating {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 20:44:33 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Creating image(s)
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'trusted_certs' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue" returned: 0 in 0.050s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'migration_context' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.base [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<ceeb436d-1451-4477-8f02-60d1e3a52d93> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Start _get_guest_xml network_info=[{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "vif_mac": "fa:16:3e:6e:61:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'resources' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.base [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<ceeb436d-1451-4477-8f02-60d1e3a52d93> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'numa_topology' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.base [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<ceeb436d-1451-4477-8f02-60d1e3a52d93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:44:33 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:44:33 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'vcpu_model' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.base [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<ceeb436d-1451-4477-8f02-60d1e3a52d93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-44444427',display_name='tempest-ServerRescueNegativeTestJSON-server-44444427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-44444427',id=18,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:39:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-59ap0w1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:39:59Z,user_data=None,user_id='5d5a850b0e6c48359f78aa669b038897',uuid=ceeb436d-1451-4477-8f02-60d1e3a52d93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "vif_mac": "fa:16:3e:6e:61:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "vif_mac": "fa:16:3e:6e:61:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:61:bc,bridge_name='br-int',has_traffic_filtering=True,id=64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3e9a-8d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'pci_devices' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.objects.base [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<ceeb436d-1451-4477-8f02-60d1e3a52d93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:44:33 user nova-compute[76442]:   <uuid>ceeb436d-1451-4477-8f02-60d1e3a52d93</uuid>
Nov 14 20:44:33 user nova-compute[76442]:   <name>instance-00000012</name>
Nov 14 20:44:33 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:44:33 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:44:33 user nova-compute[76442]:   <metadata>
Nov 14 20:44:33 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:44:33 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:44:33 user nova-compute[76442]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-44444427</nova:name>
Nov 14 20:44:33 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:44:33</nova:creationTime>
Nov 14 20:44:33 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:44:33 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:44:33 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:44:33 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:44:33 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:44:33 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:44:33 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:44:33 user nova-compute[76442]:       <nova:owner>
Nov 14 20:44:33 user nova-compute[76442]:         <nova:user uuid="5d5a850b0e6c48359f78aa669b038897">tempest-ServerRescueNegativeTestJSON-916964129-project-member</nova:user>
Nov 14 20:44:33 user nova-compute[76442]:         <nova:project uuid="69cc7950cfcf40b180d65bc96e28a2e3">tempest-ServerRescueNegativeTestJSON-916964129</nova:project>
Nov 14 20:44:33 user nova-compute[76442]:       </nova:owner>
Nov 14 20:44:33 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:44:33 user nova-compute[76442]:       <nova:ports>
Nov 14 20:44:33 user nova-compute[76442]:         <nova:port uuid="64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9">
Nov 14 20:44:33 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 20:44:33 user nova-compute[76442]:         </nova:port>
Nov 14 20:44:33 user nova-compute[76442]:       </nova:ports>
Nov 14 20:44:33 user nova-compute[76442]:     </nova:instance>
Nov 14 20:44:33 user nova-compute[76442]:   </metadata>
Nov 14 20:44:33 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:44:33 user nova-compute[76442]:     <system>
Nov 14 20:44:33 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:44:33 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:44:33 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:44:33 user nova-compute[76442]:       <entry name="serial">ceeb436d-1451-4477-8f02-60d1e3a52d93</entry>
Nov 14 20:44:33 user nova-compute[76442]:       <entry name="uuid">ceeb436d-1451-4477-8f02-60d1e3a52d93</entry>
Nov 14 20:44:33 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:44:33 user nova-compute[76442]:     </system>
Nov 14 20:44:33 user nova-compute[76442]:   </sysinfo>
Nov 14 20:44:33 user nova-compute[76442]:   <os>
Nov 14 20:44:33 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:44:33 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:44:33 user nova-compute[76442]:   </os>
Nov 14 20:44:33 user nova-compute[76442]:   <features>
Nov 14 20:44:33 user nova-compute[76442]:     <acpi/>
Nov 14 20:44:33 user nova-compute[76442]:     <apic/>
Nov 14 20:44:33 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:44:33 user nova-compute[76442]:   </features>
Nov 14 20:44:33 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:44:33 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:44:33 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:44:33 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:44:33 user nova-compute[76442]:   </clock>
Nov 14 20:44:33 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:44:33 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:44:33 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:44:33 user nova-compute[76442]:   </cpu>
Nov 14 20:44:33 user nova-compute[76442]:   <devices>
Nov 14 20:44:33 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:44:33 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:44:33 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue"/>
Nov 14 20:44:33 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:44:33 user nova-compute[76442]:     </disk>
Nov 14 20:44:33 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:44:33 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:44:33 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk"/>
Nov 14 20:44:33 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:44:33 user nova-compute[76442]:     </disk>
Nov 14 20:44:33 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:44:33 user nova-compute[76442]:       <mac address="fa:16:3e:6e:61:bc"/>
Nov 14 20:44:33 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:44:33 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:44:33 user nova-compute[76442]:       <target dev="tap64ae3e9a-8d"/>
Nov 14 20:44:33 user nova-compute[76442]:     </interface>
Nov 14 20:44:33 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:44:33 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/console.log" append="off"/>
Nov 14 20:44:33 user nova-compute[76442]:     </serial>
Nov 14 20:44:33 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:44:33 user nova-compute[76442]:     <video>
Nov 14 20:44:33 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:44:33 user nova-compute[76442]:     </video>
Nov 14 20:44:33 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:44:33 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:44:33 user nova-compute[76442]:     </rng>
Nov 14 20:44:33 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:44:33 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:44:33 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:44:33 user nova-compute[76442]:     </memballoon>
Nov 14 20:44:33 user nova-compute[76442]:   </devices>
Nov 14 20:44:33 user nova-compute[76442]: </domain>
Nov 14 20:44:33 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:44:33 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Instance destroyed successfully.
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:44:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No VIF found with MAC fa:16:3e:6e:61:bc, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:44:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:34 user nova-compute[76442]: INFO nova.compute.manager [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Terminating instance
Nov 14 20:44:34 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:44:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:44:35 user nova-compute[76442]: WARNING nova.compute.manager [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state active and task_state rescuing.
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received event network-vif-unplugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] No waiting events found dispatching network-vif-unplugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received event network-vif-unplugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received event network-vif-plugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] Acquiring lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] No waiting events found dispatching network-vif-plugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:44:35 user nova-compute[76442]: WARNING nova.compute.manager [req-249e89cb-cc60-4185-9a0b-df5da13acab4 req-6ac3a1a4-31f5-4c8b-87d6-2db6462c2e97 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received unexpected event network-vif-plugged-ad752cd2-4691-4d90-bb08-ccbfe1e7795c for instance with vm_state active and task_state deleting.
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Instance destroyed successfully.
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.objects.instance [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'resources' on Instance uuid a48740e3-01af-4599-91d9-8715bc3f8b3e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:41:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-198642135',display_name='tempest-AttachVolumeNegativeTest-server-198642135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-198642135',id=22,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcnmsED655i8pklIdsCimEWL5blddTPz6jD40oSyjnDIq8HSo1q/gH/5Gpg6jWoylLQ+3jqlidXKj967zqPtz2L/XSiuUiO8LMNQSoHhSBo++XJDhXbqioywa0L2uWZ6w==',key_name='tempest-keypair-180261515',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-5nthnlxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=a48740e3-01af-4599-91d9-8715bc3f8b3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "address": "fa:16:3e:ba:87:39", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad752cd2-46", "ovs_interfaceid": "ad752cd2-4691-4d90-bb08-ccbfe1e7795c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:87:39,bridge_name='br-int',has_traffic_filtering=True,id=ad752cd2-4691-4d90-bb08-ccbfe1e7795c,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad752cd2-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG os_vif [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:87:39,bridge_name='br-int',has_traffic_filtering=True,id=ad752cd2-4691-4d90-bb08-ccbfe1e7795c,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad752cd2-46') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad752cd2-46, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e92457c-4400-4fc6-b1be-ae550c64cd41) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:35 user nova-compute[76442]: INFO os_vif [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:87:39,bridge_name='br-int',has_traffic_filtering=True,id=ad752cd2-4691-4d90-bb08-ccbfe1e7795c,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad752cd2-46')
Nov 14 20:44:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Deleting instance files /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e_del
Nov 14 20:44:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Deletion of /opt/stack/data/nova/instances/a48740e3-01af-4599-91d9-8715bc3f8b3e_del complete
Nov 14 20:44:35 user nova-compute[76442]: INFO nova.compute.manager [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 14 20:44:35 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:44:35 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:44:36 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:44:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-75cc6556-1f8d-4ac5-a05c-e6303a5f02be req-7a14fb54-a645-4254-a81d-8416e4a94696 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Received event network-vif-deleted-ad752cd2-4691-4d90-bb08-ccbfe1e7795c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:36 user nova-compute[76442]: INFO nova.compute.manager [req-75cc6556-1f8d-4ac5-a05c-e6303a5f02be req-7a14fb54-a645-4254-a81d-8416e4a94696 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Neutron deleted interface ad752cd2-4691-4d90-bb08-ccbfe1e7795c; detaching it from the instance and deleting it from the info cache
Nov 14 20:44:36 user nova-compute[76442]: DEBUG nova.network.neutron [req-75cc6556-1f8d-4ac5-a05c-e6303a5f02be req-7a14fb54-a645-4254-a81d-8416e4a94696 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:44:36 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Took 0.67 seconds to deallocate network for instance.
Nov 14 20:44:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-75cc6556-1f8d-4ac5-a05c-e6303a5f02be req-7a14fb54-a645-4254-a81d-8416e4a94696 service nova] [instance: a48740e3-01af-4599-91d9-8715bc3f8b3e] Detach interface failed, port_id=ad752cd2-4691-4d90-bb08-ccbfe1e7795c, reason: Instance a48740e3-01af-4599-91d9-8715bc3f8b3e could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:44:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:36 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:44:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:36 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:44:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:36 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Deleted allocations for instance a48740e3-01af-4599-91d9-8715bc3f8b3e
Nov 14 20:44:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f2ca8aa-c346-4aaa-b0e3-9258fec351a0 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "a48740e3-01af-4599-91d9-8715bc3f8b3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:44:37 user nova-compute[76442]: WARNING nova.compute.manager [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state active and task_state rescuing.
Nov 14 20:44:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:44:37 user nova-compute[76442]: WARNING nova.compute.manager [req-f42f0721-58de-4570-9885-642f8c6be384 req-f59e033e-5dd3-41dc-a342-6f2a00366cb7 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state active and task_state rescuing.
Nov 14 20:44:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-31bffd61-4bfb-4982-a611-1d644e97f051 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:44:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 req-29a4b32e-4f65-474a-a8cc-12453715609b service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event volume-reimaged-69c8788c-116f-4c6d-9a69-e6ebd291f72f {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 req-29a4b32e-4f65-474a-a8cc-12453715609b service nova] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 req-29a4b32e-4f65-474a-a8cc-12453715609b service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 req-29a4b32e-4f65-474a-a8cc-12453715609b service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 req-29a4b32e-4f65-474a-a8cc-12453715609b service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Processing event volume-reimaged-69c8788c-116f-4c6d-9a69-e6ebd291f72f {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 20:44:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance event wait completed in 12 seconds for volume-reimaged {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:44:44 user nova-compute[76442]: INFO nova.virt.block_device [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Booting with volume 69c8788c-116f-4c6d-9a69-e6ebd291f72f at /dev/vda
Nov 14 20:44:45 user nova-compute[76442]: DEBUG os_brick.utils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16156ae-06d4-4c5c-9ed1-5eebd4e63faf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bb9ce6-94fe-4724-ad54-f1440adb70d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[df58ae44-2578-40bf-8311-9bfe4f2b36f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cecc877-dd92-49dc-bde3-945fdf842443]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:44:45 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:44:45 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c94f0-e22c-4c45-843b-e04f1e28d510]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG os_brick.utils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Updating existing volume attachment record: c5e0cf4c-e08e-4a31-bf89-9a67e301abd3 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:44:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:44:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Creating image(s)
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Ensure instance console log exists: /opt/stack/data/nova/instances/3b28c6e1-5191-48fd-be07-d1af671b0695/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Start _get_guest_xml network_info=[{"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRtcSXzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b28c6e1-5191-48fd-be07-d1af671b0695', 'attached_at': '', 'detached_at': '', 'volume_id': '69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'serial': '69c8788c-116f-4c6d-9a69-e6ebd291f72f'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'c5e0cf4c-e08e-4a31-bf89-9a67e301abd3', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:44:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 20:44:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.objects.instance [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b28c6e1-5191-48fd-be07-d1af671b0695 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRtcSXzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:44:49 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:44:49 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:44:49 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcac4ac-882f-444b-96bc-d4943fd5d4ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:44:49 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6a67d3-6037-4848-8b80-f32f6308385b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f] added
Nov 14 20:44:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f9d0a3-0ec1-410b-9aea-148ddf1d0b64]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[569881eb-783c-4350-9f42-f356a765298e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRtcSXzB {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRtcSXzB" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1640de-72d5-4dd9-ad90-8e03aa25ed22]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRtcSXzB'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[69186ee5-9204-4fe9-abd1-460892f9d0cd]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e96271-b865-484a-926c-cf17d826a2a6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd60de0-b87d-49fe-96b7-25577c7af2c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260]
Nov 14 20:44:49 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260] successful.
Nov 14 20:44:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f07cf09-5709-4941-a32b-468364414d81]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b66698-858e-45ca-a839-9a02089427f1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:49 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:44:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:44:49 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:44:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d65b8ac-2ea1-414e-bd83-1675b4fb5a57]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:44:49 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRtcSXzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26564666235653435', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564666235653435', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-592433099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-45726840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY9gZC8aB/JVqRnz6O+jEJIYx3p8DCBh9I7CmcOwY/m7HTA/XQPaLwT4ucWvMGkpa+45IFG/yxglKz5lQd7V/yRTk6SXIoIm2npdlarA3QE1Y1entI5IU/P4Rc/W1pfyQ==',key_name='tempest-keypair-1596655746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:42:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ce7cf07105a4357920a0e48d02e38f4',ramdisk_id='',reservation_id='r-jexecte0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1273726129',owner_user_name='tempest-ServerActionsV293TestJSON-1273726129-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:44:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6972c92678b245978e9692d3a75da62d',uuid=3b28c6e1-5191-48fd-be07-d1af671b0695,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converting VIF {"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:44:50 user nova-compute[76442]:   <uuid>3b28c6e1-5191-48fd-be07-d1af671b0695</uuid>
Nov 14 20:44:50 user nova-compute[76442]:   <name>instance-00000018</name>
Nov 14 20:44:50 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:44:50 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:44:50 user nova-compute[76442]:   <metadata>
Nov 14 20:44:50 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:44:50 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:44:50 user nova-compute[76442]:       <nova:name>tempest-ServerActionsV293TestJSON-server-592433099</nova:name>
Nov 14 20:44:50 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:44:49</nova:creationTime>
Nov 14 20:44:50 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:44:50 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:44:50 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:44:50 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:44:50 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:44:50 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:44:50 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:44:50 user nova-compute[76442]:       <nova:owner>
Nov 14 20:44:50 user nova-compute[76442]:         <nova:user uuid="6972c92678b245978e9692d3a75da62d">tempest-ServerActionsV293TestJSON-1273726129-project-member</nova:user>
Nov 14 20:44:50 user nova-compute[76442]:         <nova:project uuid="4ce7cf07105a4357920a0e48d02e38f4">tempest-ServerActionsV293TestJSON-1273726129</nova:project>
Nov 14 20:44:50 user nova-compute[76442]:       </nova:owner>
Nov 14 20:44:50 user nova-compute[76442]:       <nova:ports>
Nov 14 20:44:50 user nova-compute[76442]:         <nova:port uuid="fb8ed0c1-0dd9-4677-b881-904340c8fbf5">
Nov 14 20:44:50 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 20:44:50 user nova-compute[76442]:         </nova:port>
Nov 14 20:44:50 user nova-compute[76442]:       </nova:ports>
Nov 14 20:44:50 user nova-compute[76442]:     </nova:instance>
Nov 14 20:44:50 user nova-compute[76442]:   </metadata>
Nov 14 20:44:50 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:44:50 user nova-compute[76442]:     <system>
Nov 14 20:44:50 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:44:50 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:44:50 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:44:50 user nova-compute[76442]:       <entry name="serial">3b28c6e1-5191-48fd-be07-d1af671b0695</entry>
Nov 14 20:44:50 user nova-compute[76442]:       <entry name="uuid">3b28c6e1-5191-48fd-be07-d1af671b0695</entry>
Nov 14 20:44:50 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:44:50 user nova-compute[76442]:     </system>
Nov 14 20:44:50 user nova-compute[76442]:   </sysinfo>
Nov 14 20:44:50 user nova-compute[76442]:   <os>
Nov 14 20:44:50 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:44:50 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:44:50 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:44:50 user nova-compute[76442]:   </os>
Nov 14 20:44:50 user nova-compute[76442]:   <features>
Nov 14 20:44:50 user nova-compute[76442]:     <acpi/>
Nov 14 20:44:50 user nova-compute[76442]:     <apic/>
Nov 14 20:44:50 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:44:50 user nova-compute[76442]:   </features>
Nov 14 20:44:50 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:44:50 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:44:50 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:44:50 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:44:50 user nova-compute[76442]:   </clock>
Nov 14 20:44:50 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:44:50 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:44:50 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:44:50 user nova-compute[76442]:   </cpu>
Nov 14 20:44:50 user nova-compute[76442]:   <devices>
Nov 14 20:44:50 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:44:50 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:44:50 user nova-compute[76442]:       <source dev="/dev/sdc"/>
Nov 14 20:44:50 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:44:50 user nova-compute[76442]:       <serial>69c8788c-116f-4c6d-9a69-e6ebd291f72f</serial>
Nov 14 20:44:50 user nova-compute[76442]:     </disk>
Nov 14 20:44:50 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:44:50 user nova-compute[76442]:       <mac address="fa:16:3e:a9:83:be"/>
Nov 14 20:44:50 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:44:50 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:44:50 user nova-compute[76442]:       <target dev="tapfb8ed0c1-0d"/>
Nov 14 20:44:50 user nova-compute[76442]:     </interface>
Nov 14 20:44:50 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:44:50 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/3b28c6e1-5191-48fd-be07-d1af671b0695/console.log" append="off"/>
Nov 14 20:44:50 user nova-compute[76442]:     </serial>
Nov 14 20:44:50 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:44:50 user nova-compute[76442]:     <video>
Nov 14 20:44:50 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:44:50 user nova-compute[76442]:     </video>
Nov 14 20:44:50 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:44:50 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:44:50 user nova-compute[76442]:     </rng>
Nov 14 20:44:50 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:44:50 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:44:50 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:44:50 user nova-compute[76442]:     </memballoon>
Nov 14 20:44:50 user nova-compute[76442]:   </devices>
Nov 14 20:44:50 user nova-compute[76442]: </domain>
Nov 14 20:44:50 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-592433099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-45726840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY9gZC8aB/JVqRnz6O+jEJIYx3p8DCBh9I7CmcOwY/m7HTA/XQPaLwT4ucWvMGkpa+45IFG/yxglKz5lQd7V/yRTk6SXIoIm2npdlarA3QE1Y1entI5IU/P4Rc/W1pfyQ==',key_name='tempest-keypair-1596655746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:42:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4ce7cf07105a4357920a0e48d02e38f4',ramdisk_id='',reservation_id='r-jexecte0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1273726129',owner_user_name='tempest-ServerActionsV293TestJSON-1273726129-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:44:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6972c92678b245978e9692d3a75da62d',uuid=3b28c6e1-5191-48fd-be07-d1af671b0695,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converting VIF {"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG os_vif [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6073d60e-2106-54e3-b415-d3d1c0421f21', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:44:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb8ed0c1-0d, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb8ed0c1-0d, col_values=(('qos', UUID('cfc0a16f-f5b7-4580-b9ae-576236973dda')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb8ed0c1-0d, col_values=(('external_ids', {'iface-id': 'fb8ed0c1-0dd9-4677-b881-904340c8fbf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:83:be', 'vm-uuid': '3b28c6e1-5191-48fd-be07-d1af671b0695'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:51 user nova-compute[76442]: INFO os_vif [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d')
Nov 14 20:44:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] No VIF found with MAC fa:16:3e:a9:83:be, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:44:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-063b3c3c-55f7-4e8f-aa5d-2fdc9ff376d1 req-bcfe41f8-6940-46fc-9dc4-506643596eb6 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-063b3c3c-55f7-4e8f-aa5d-2fdc9ff376d1 req-bcfe41f8-6940-46fc-9dc4-506643596eb6 service nova] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-063b3c3c-55f7-4e8f-aa5d-2fdc9ff376d1 req-bcfe41f8-6940-46fc-9dc4-506643596eb6 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-063b3c3c-55f7-4e8f-aa5d-2fdc9ff376d1 req-bcfe41f8-6940-46fc-9dc4-506643596eb6 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-063b3c3c-55f7-4e8f-aa5d-2fdc9ff376d1 req-bcfe41f8-6940-46fc-9dc4-506643596eb6 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] No waiting events found dispatching network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:44:52 user nova-compute[76442]: WARNING nova.compute.manager [req-063b3c3c-55f7-4e8f-aa5d-2fdc9ff376d1 req-bcfe41f8-6940-46fc-9dc4-506643596eb6 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received unexpected event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 20:44:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:44:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance spawned successfully.
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-73b362b0-2381-4837-ac46-d19da6138fe3 req-d3785736-ecf2-4e8f-95f8-a16c9ffa2870 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-73b362b0-2381-4837-ac46-d19da6138fe3 req-d3785736-ecf2-4e8f-95f8-a16c9ffa2870 service nova] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-73b362b0-2381-4837-ac46-d19da6138fe3 req-d3785736-ecf2-4e8f-95f8-a16c9ffa2870 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-73b362b0-2381-4837-ac46-d19da6138fe3 req-d3785736-ecf2-4e8f-95f8-a16c9ffa2870 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-73b362b0-2381-4837-ac46-d19da6138fe3 req-d3785736-ecf2-4e8f-95f8-a16c9ffa2870 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] No waiting events found dispatching network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:44:54 user nova-compute[76442]: WARNING nova.compute.manager [req-73b362b0-2381-4837-ac46-d19da6138fe3 req-d3785736-ecf2-4e8f-95f8-a16c9ffa2870 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received unexpected event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 20:44:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG nova.objects.instance [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76442) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 20:44:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00a16b6a-04ad-45f3-bcaa-52a82e4a8818 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:44:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:44:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:01 user nova-compute[76442]: INFO nova.compute.manager [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Terminating instance
Nov 14 20:45:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-1c0ea1c0-2da1-4f19-a2d1-ef2e018044b4 req-dbe59b84-a21f-4b14-a969-d3acd4576831 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-unplugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1c0ea1c0-2da1-4f19-a2d1-ef2e018044b4 req-dbe59b84-a21f-4b14-a969-d3acd4576831 service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1c0ea1c0-2da1-4f19-a2d1-ef2e018044b4 req-dbe59b84-a21f-4b14-a969-d3acd4576831 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1c0ea1c0-2da1-4f19-a2d1-ef2e018044b4 req-dbe59b84-a21f-4b14-a969-d3acd4576831 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-1c0ea1c0-2da1-4f19-a2d1-ef2e018044b4 req-dbe59b84-a21f-4b14-a969-d3acd4576831 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-unplugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-1c0ea1c0-2da1-4f19-a2d1-ef2e018044b4 req-dbe59b84-a21f-4b14-a969-d3acd4576831 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-unplugged-efe55142-461c-40ce-a422-d396af94b09d for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Instance destroyed successfully.
Nov 14 20:45:01 user nova-compute[76442]: DEBUG nova.objects.instance [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'resources' on Instance uuid d7c90b52-307d-4a1d-98ab-68449f84c3f2 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:45:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878133652',display_name='tempest-AttachVolumeTestJSON-server-878133652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878133652',id=4,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDheVhyXKd1tLetq6drOD0c1HXCNMGuyk4trFFV+OHU/w0jSDxWd/s0s9dAgCq1IdTQzrf7GK4Rv/3WoY7/OLU1yzzvADVAojoOIUFiIYeEUqj31jXAcxcBX+C/r+XI6AQ==',key_name='tempest-keypair-857353389',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-nein8fe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:43:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=d7c90b52-307d-4a1d-98ab-68449f84c3f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "efe55142-461c-40ce-a422-d396af94b09d", "address": "fa:16:3e:d2:0d:f0", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefe55142-46", "ovs_interfaceid": "efe55142-461c-40ce-a422-d396af94b09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG os_vif [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefe55142-46, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ae6f1b1-f9c9-4279-a459-6e0110f2b759) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:02 user nova-compute[76442]: INFO os_vif [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:0d:f0,bridge_name='br-int',has_traffic_filtering=True,id=efe55142-461c-40ce-a422-d396af94b09d,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefe55142-46')
Nov 14 20:45:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Deleting instance files /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2_del
Nov 14 20:45:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Deletion of /opt/stack/data/nova/instances/d7c90b52-307d-4a1d-98ab-68449f84c3f2_del complete
Nov 14 20:45:02 user nova-compute[76442]: INFO nova.compute.manager [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:02 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Took 0.72 seconds to deallocate network for instance.
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-fbaf47c2-ba65-455c-a128-6ac1df3fa03b req-e7ab3baf-453c-480b-b67e-9cd274e1bff9 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-deleted-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:02 user nova-compute[76442]: INFO nova.compute.manager [req-fbaf47c2-ba65-455c-a128-6ac1df3fa03b req-e7ab3baf-453c-480b-b67e-9cd274e1bff9 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Neutron deleted interface efe55142-461c-40ce-a422-d396af94b09d; detaching it from the instance and deleting it from the info cache
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.network.neutron [req-fbaf47c2-ba65-455c-a128-6ac1df3fa03b req-e7ab3baf-453c-480b-b67e-9cd274e1bff9 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-fbaf47c2-ba65-455c-a128-6ac1df3fa03b req-e7ab3baf-453c-480b-b67e-9cd274e1bff9 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Detach interface failed, port_id=efe55142-461c-40ce-a422-d396af94b09d, reason: Instance d7c90b52-307d-4a1d-98ab-68449f84c3f2 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:03 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Deleted allocations for instance d7c90b52-307d-4a1d-98ab-68449f84c3f2
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1d0d4b25-b681-4f5e-b5a8-2e5dc7130f8e tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.255s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-ce199897-d98f-4aae-8181-03a9f081455c req-207acae5-9401-449c-a104-e98ee8312a63 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ce199897-d98f-4aae-8181-03a9f081455c req-207acae5-9401-449c-a104-e98ee8312a63 service nova] Acquiring lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ce199897-d98f-4aae-8181-03a9f081455c req-207acae5-9401-449c-a104-e98ee8312a63 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ce199897-d98f-4aae-8181-03a9f081455c req-207acae5-9401-449c-a104-e98ee8312a63 service nova] Lock "d7c90b52-307d-4a1d-98ab-68449f84c3f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-ce199897-d98f-4aae-8181-03a9f081455c req-207acae5-9401-449c-a104-e98ee8312a63 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] No waiting events found dispatching network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:03 user nova-compute[76442]: WARNING nova.compute.manager [req-ce199897-d98f-4aae-8181-03a9f081455c req-207acae5-9401-449c-a104-e98ee8312a63 service nova] [instance: d7c90b52-307d-4a1d-98ab-68449f84c3f2] Received unexpected event network-vif-plugged-efe55142-461c-40ce-a422-d396af94b09d for instance with vm_state deleted and task_state None.
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:45:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:07 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:45:07 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7431MB free_disk=25.219757080078125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 31c7399a-07f6-40d7-a62c-8fa374193ba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2458523e-c461-4cd5-903c-2d7ab0222162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3b28c6e1-5191-48fd-be07-d1af671b0695 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 88dd9488-e777-4b33-9702-e8f0353a62c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 447a1211-ebb6-4b4e-9207-047312e59f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.objects.instance [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lazy-loading 'flavor' on Instance uuid 2458523e-c461-4cd5-903c-2d7ab0222162 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:07 user nova-compute[76442]: INFO nova.compute.manager [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Attaching volume 4e45b5f2-cc4b-4abd-b79b-64187c75978a to /dev/vdb
Nov 14 20:45:07 user nova-compute[76442]: DEBUG os_brick.utils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65d84ca-451a-486e-afa2-5579c507f0e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[60129a23-cfb0-4658-96bc-df83434ef04d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7e3bf7-7d62-4852-b339-7e3dc1252915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc292a55-408d-44c3-9807-e34b4baeaf63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:45:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:45:08 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:45:08 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b581c4d-3b5d-418b-aa25-8846163bb7af]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG os_brick.utils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating existing volume attachment record: c6f3dcd9-1293-43ba-ba85-fecd79c3941c {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-31c7399a-07f6-40d7-a62c-8fa374193ba0" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-31c7399a-07f6-40d7-a62c-8fa374193ba0" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:45:08 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:45:09 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Updating instance_info_cache with network_info: [{"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-31c7399a-07f6-40d7-a62c-8fa374193ba0" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:45:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:45:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:12 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:12 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:12 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de3aadd-e193-4c30-9518-f5989f6c66da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:45:12 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[223e7f84-69ee-416d-9d0c-8babbddbca20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a] added
Nov 14 20:45:12 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8682b2-3ef4-492d-897b-0e41ec064901]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[118fa523-f59d-42f5-ac1f-f5ca12460171]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQFbkNXl {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQFbkNXl" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab388e-6cc0-493b-b833-2c2cbfa7ecc1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rQFbkNXl'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1674e966-dff8-45b7-aae2-1dd141a5fc37]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f71fe0-6093-49b9-bac7-983b0af4834b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:12 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:12 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:12 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:12 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b4d55b-7e5c-4a2e-8e2a-6ba1df5c0595]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]
Nov 14 20:45:12 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.
Nov 14 20:45:12 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb7e306-22ca-42f9-90ea-360450bb012c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aeaee9-b9f8-4d17-abf5-c66221c8b1c3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:12 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:12 user nova-compute[76442]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:12 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:12 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:12 user nova-compute[76442]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:12 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667e7cf-15f5-4092-b977-91e402402e8b]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:45:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:45:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23136656466633737', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136656466633737', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:45:13 user nova-compute[76442]: DEBUG nova.objects.instance [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lazy-loading 'flavor' on Instance uuid 2458523e-c461-4cd5-903c-2d7ab0222162 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:45:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:45:13 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:45:13 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:45:13 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:45:13 user nova-compute[76442]:   <serial>4e45b5f2-cc4b-4abd-b79b-64187c75978a</serial>
Nov 14 20:45:13 user nova-compute[76442]: </disk>
Nov 14 20:45:13 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:45:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] No VIF found with MAC fa:16:3e:6f:d7:73, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:45:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-57123b8c-6525-471d-b0a4-cccb2343183f tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.425s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Stashing vm_state: active {{(pid=76442) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:45:16 user nova-compute[76442]: INFO nova.compute.claims [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Claim successful on node user
Nov 14 20:45:16 user nova-compute[76442]: INFO nova.compute.resource_tracker [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating resource usage from migration e25a099f-4abf-4657-9a70-e8a9e6c07f7e
Nov 14 20:45:16 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.426s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:16 user nova-compute[76442]: INFO nova.compute.manager [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Migrating
Nov 14 20:45:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquired lock "compute-rpcapi-router" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:45:16 user nova-compute[76442]: INFO nova.compute.rpcapi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 20:45:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Releasing lock "compute-rpcapi-router" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquired lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:45:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating instance_info_cache with network_info: [{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Releasing lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Starting migrate_disk_and_power_off {{(pid=76442) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG nova.compute.manager [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:17 user nova-compute[76442]: INFO nova.compute.manager [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] instance snapshotting
Nov 14 20:45:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:17 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Beginning live snapshot process
Nov 14 20:45:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-622b3757-656b-4695-93d1-dd9d6504f0a1 req-8dced91c-fbec-4552-acea-5ce74efcd20f service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-unplugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-622b3757-656b-4695-93d1-dd9d6504f0a1 req-8dced91c-fbec-4552-acea-5ce74efcd20f service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-622b3757-656b-4695-93d1-dd9d6504f0a1 req-8dced91c-fbec-4552-acea-5ce74efcd20f service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-622b3757-656b-4695-93d1-dd9d6504f0a1 req-8dced91c-fbec-4552-acea-5ce74efcd20f service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-622b3757-656b-4695-93d1-dd9d6504f0a1 req-8dced91c-fbec-4552-acea-5ce74efcd20f service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-unplugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:17 user nova-compute[76442]: WARNING nova.compute.manager [req-622b3757-656b-4695-93d1-dd9d6504f0a1 req-8dced91c-fbec-4552-acea-5ce74efcd20f service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-unplugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state active and task_state resize_migrating.
Nov 14 20:45:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json -f qcow2 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json -f qcow2 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance destroyed successfully.
Nov 14 20:45:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172479319',display_name='tempest-ServerActionsTestOtherB-server-172479319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172479319',id=23,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1w5ZQtpg99v5QhQpY/KBiq/xXDr7VzQC2xw087O/wNCNSflAIntMOx1Fw4GV4r8zvn0kw90vwhVLFroQhtXcr2jLFgnpFnY97fquWjOk/BVWAbsopYRXAkQYhcW7Uxdw==',key_name='tempest-keypair-1429056730',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:42:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05bc76da5dd841a88a4c8bba03e288aa',ramdisk_id='',reservation_id='r-fh10qe39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2105462622',owner_user_name='tempest-ServerActionsTestOtherB-2105462622-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497dbbf201694a4e99ba98ebb9cf8e1a',uuid=2458523e-c461-4cd5-903c-2d7ab0222162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-238515712-network", "vif_mac": "fa:16:3e:6f:d7:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converting VIF {"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-238515712-network", "vif_mac": "fa:16:3e:6f:d7:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_vif [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d5ec5ad-76, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b93b6ee0-696d-4a7b-9522-ca8e1a43f5ab) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:18 user nova-compute[76442]: INFO os_vif [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76')
Nov 14 20:45:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:18 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18feee8-8a8d-4997-9e8e-04f9e5bd12a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:45:18 user nova-compute[76442]: No targets found.
Nov 14 20:45:18 user nova-compute[76442]: iSNS:
Nov 14 20:45:18 user nova-compute[76442]: No targets found.
Nov 14 20:45:18 user nova-compute[76442]: STATIC:
Nov 14 20:45:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:45:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f
Nov 14 20:45:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:45:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:18 user nova-compute[76442]: FIRMWARE:
Nov 14 20:45:18 user nova-compute[76442]: No targets found.
Nov 14 20:45:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:45:18 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:45:18 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b6916a-31b8-456f-acfd-ef094d48c1ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2122a847-beeb-41f9-bb7a-1c72514dd5ac]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:18 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:18 user nova-compute[76442]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:18 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:18 user nova-compute[76442]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e84b3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwzfq19x1/ac7c4d44702a40fb983419b2aae0ec97.delta 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8d7d42-4c36-404e-b82d-d69f970404b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwzfq19x1/ac7c4d44702a40fb983419b2aae0ec97.delta 1073741824" returned: 0 in 0.050s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f12e4-0cdd-4956-be2a-fbc3026b6c73]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c193ecd3-e4a9-45a0-a9eb-7a2d1a463081]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af4e512-a983-47ba-b6de-ae63ef287674]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5b8fa2-3df4-445c-aa56-0a92b9dfabdb]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5416a5ec-8be5-43a5-bc56-d379eeb2492e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]
Nov 14 20:45:18 user nova-compute[76442]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.
Nov 14 20:45:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caf9832-c927-4f51-a160-1697d6e3f481]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] <== disconnect_volume: return (322ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:45:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162_resize/disk /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "cp -r /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162_resize/disk /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk" returned: 0 in 0.699s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162_resize/disk.info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk.info {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "cp -r /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162_resize/disk.info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk.info" returned: 0 in 0.035s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:45:19 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 20:45:19 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwzfq19x1/ac7c4d44702a40fb983419b2aae0ec97.delta /opt/stack/data/nova/instances/snapshots/tmpwzfq19x1/ac7c4d44702a40fb983419b2aae0ec97 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-5fe85d0a-e840-439a-89ab-836be657acee req-0e1cab10-3a26-4565-a2c0-7552b0ba7509 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5fe85d0a-e840-439a-89ab-836be657acee req-0e1cab10-3a26-4565-a2c0-7552b0ba7509 service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5fe85d0a-e840-439a-89ab-836be657acee req-0e1cab10-3a26-4565-a2c0-7552b0ba7509 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5fe85d0a-e840-439a-89ab-836be657acee req-0e1cab10-3a26-4565-a2c0-7552b0ba7509 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-5fe85d0a-e840-439a-89ab-836be657acee req-0e1cab10-3a26-4565-a2c0-7552b0ba7509 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:19 user nova-compute[76442]: WARNING nova.compute.manager [req-5fe85d0a-e840-439a-89ab-836be657acee req-0e1cab10-3a26-4565-a2c0-7552b0ba7509 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state active and task_state resize_migrating.
Nov 14 20:45:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwzfq19x1/ac7c4d44702a40fb983419b2aae0ec97.delta /opt/stack/data/nova/instances/snapshots/tmpwzfq19x1/ac7c4d44702a40fb983419b2aae0ec97" returned: 0 in 0.641s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:20 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Snapshot extracted, beginning image upload
Nov 14 20:45:20 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Port 9d5ec5ad-760e-438c-9e3b-b178e43f9e98 binding to destination host user is already ACTIVE {{(pid=76442) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 20:45:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquired lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating instance_info_cache with network_info: [{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Releasing lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG os_brick.utils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e33c21-2214-42c3-a325-62da319f9a7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6b070a-346d-46d1-872c-1ffe76794a15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0668010e-7571-477e-b782-99022a8bd8cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1509ce19-5710-4f1e-bd24-b83355e37fb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:45:21 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:45:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2249a20-7317-417f-b5fe-6db6bcbda81e]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG os_brick.utils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:22 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Snapshot image upload complete
Nov 14 20:45:22 user nova-compute[76442]: INFO nova.compute.manager [None req-b1fe1229-fe7a-4add-a092-f4a884363bd8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Took 5.46 seconds to snapshot the instance on the hypervisor.
Nov 14 20:45:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Starting finish_migration {{(pid=76442) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance directory exists: not creating {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 20:45:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Creating image(s)
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk. size=21474836480 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk 21474836480 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk 21474836480" returned: 0 in 0.059s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Ensure instance console log exists: /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Start _get_guest_xml network_info=[{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-238515712-network", "vif_mac": "fa:16:3e:6f:d7:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2458523e-c461-4cd5-903c-2d7ab0222162', 'attached_at': '2023-11-14T20:45:26.000000', 'detached_at': '', 'volume_id': '4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'serial': '4e45b5f2-cc4b-4abd-b79b-64187c75978a'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'attachment_id': '6b0147cd-7409-4b7a-8f5f-4f3070b106d2', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:45:26 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:45:26 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:26 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:26 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:26 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0ef971-094d-4dd5-aff8-7f1efc36d8f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:45:26 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f118891-2453-4d2b-bc49-fc27862cf838]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a] added
Nov 14 20:45:26 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[77657ef9-f186-4e71-908c-cd68e80729e6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09ab6d5-9a05-4e20-9c2e-542f0870be3e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQFbkNXl {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQFbkNXl" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36b9559-43e0-4731-bd9b-9ce4449e9230]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rQFbkNXl'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d66091-f2c8-43ed-a478-f0d73ab59436]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cbe074-5357-4ce5-9c84-3eef755ddfa7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:27 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:27 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[961b338e-faf7-4d84-8139-fe8a93de41a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]
Nov 14 20:45:27 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.
Nov 14 20:45:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e8289-0393-47af-9d89-359c02c3e3eb]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89dbcf2-f32f-4f38-8b2f-37fb9196820a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:27 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:27 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:27 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:27 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddaf38e-1848-4202-a2bd-744625b8ca34]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:45:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23136656466633737', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136656466633737', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172479319',display_name='tempest-ServerActionsTestOtherB-server-172479319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172479319',id=23,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1w5ZQtpg99v5QhQpY/KBiq/xXDr7VzQC2xw087O/wNCNSflAIntMOx1Fw4GV4r8zvn0kw90vwhVLFroQhtXcr2jLFgnpFnY97fquWjOk/BVWAbsopYRXAkQYhcW7Uxdw==',key_name='tempest-keypair-1429056730',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:42:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05bc76da5dd841a88a4c8bba03e288aa',ramdisk_id='',reservation_id='r-fh10qe39',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2105462622',owner_user_name='tempest-ServerActionsTestOtherB-2105462622-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497dbbf201694a4e99ba98ebb9cf8e1a',uuid=2458523e-c461-4cd5-903c-2d7ab0222162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-238515712-network", "vif_mac": "fa:16:3e:6f:d7:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converting VIF {"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-238515712-network", "vif_mac": "fa:16:3e:6f:d7:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:45:28 user nova-compute[76442]:   <uuid>2458523e-c461-4cd5-903c-2d7ab0222162</uuid>
Nov 14 20:45:28 user nova-compute[76442]:   <name>instance-00000017</name>
Nov 14 20:45:28 user nova-compute[76442]:   <memory>2097152</memory>
Nov 14 20:45:28 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:45:28 user nova-compute[76442]:   <metadata>
Nov 14 20:45:28 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:45:28 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:45:28 user nova-compute[76442]:       <nova:name>tempest-ServerActionsTestOtherB-server-172479319</nova:name>
Nov 14 20:45:28 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:45:26</nova:creationTime>
Nov 14 20:45:28 user nova-compute[76442]:       <nova:flavor name="m1.small">
Nov 14 20:45:28 user nova-compute[76442]:         <nova:memory>2048</nova:memory>
Nov 14 20:45:28 user nova-compute[76442]:         <nova:disk>20</nova:disk>
Nov 14 20:45:28 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:45:28 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:45:28 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:45:28 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:45:28 user nova-compute[76442]:       <nova:owner>
Nov 14 20:45:28 user nova-compute[76442]:         <nova:user uuid="497dbbf201694a4e99ba98ebb9cf8e1a">tempest-ServerActionsTestOtherB-2105462622-project-member</nova:user>
Nov 14 20:45:28 user nova-compute[76442]:         <nova:project uuid="05bc76da5dd841a88a4c8bba03e288aa">tempest-ServerActionsTestOtherB-2105462622</nova:project>
Nov 14 20:45:28 user nova-compute[76442]:       </nova:owner>
Nov 14 20:45:28 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:45:28 user nova-compute[76442]:       <nova:ports>
Nov 14 20:45:28 user nova-compute[76442]:         <nova:port uuid="9d5ec5ad-760e-438c-9e3b-b178e43f9e98">
Nov 14 20:45:28 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 20:45:28 user nova-compute[76442]:         </nova:port>
Nov 14 20:45:28 user nova-compute[76442]:       </nova:ports>
Nov 14 20:45:28 user nova-compute[76442]:     </nova:instance>
Nov 14 20:45:28 user nova-compute[76442]:   </metadata>
Nov 14 20:45:28 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:45:28 user nova-compute[76442]:     <system>
Nov 14 20:45:28 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:45:28 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:45:28 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:45:28 user nova-compute[76442]:       <entry name="serial">2458523e-c461-4cd5-903c-2d7ab0222162</entry>
Nov 14 20:45:28 user nova-compute[76442]:       <entry name="uuid">2458523e-c461-4cd5-903c-2d7ab0222162</entry>
Nov 14 20:45:28 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:45:28 user nova-compute[76442]:     </system>
Nov 14 20:45:28 user nova-compute[76442]:   </sysinfo>
Nov 14 20:45:28 user nova-compute[76442]:   <os>
Nov 14 20:45:28 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:45:28 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:45:28 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:45:28 user nova-compute[76442]:   </os>
Nov 14 20:45:28 user nova-compute[76442]:   <features>
Nov 14 20:45:28 user nova-compute[76442]:     <acpi/>
Nov 14 20:45:28 user nova-compute[76442]:     <apic/>
Nov 14 20:45:28 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:45:28 user nova-compute[76442]:   </features>
Nov 14 20:45:28 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:45:28 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:45:28 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:45:28 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:45:28 user nova-compute[76442]:   </clock>
Nov 14 20:45:28 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:45:28 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:45:28 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:45:28 user nova-compute[76442]:   </cpu>
Nov 14 20:45:28 user nova-compute[76442]:   <devices>
Nov 14 20:45:28 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:45:28 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:45:28 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk"/>
Nov 14 20:45:28 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:45:28 user nova-compute[76442]:     </disk>
Nov 14 20:45:28 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:45:28 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:45:28 user nova-compute[76442]:       <source dev="/dev/sdd"/>
Nov 14 20:45:28 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:45:28 user nova-compute[76442]:       <serial>4e45b5f2-cc4b-4abd-b79b-64187c75978a</serial>
Nov 14 20:45:28 user nova-compute[76442]:     </disk>
Nov 14 20:45:28 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:45:28 user nova-compute[76442]:       <mac address="fa:16:3e:6f:d7:73"/>
Nov 14 20:45:28 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:45:28 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:45:28 user nova-compute[76442]:       <target dev="tap9d5ec5ad-76"/>
Nov 14 20:45:28 user nova-compute[76442]:     </interface>
Nov 14 20:45:28 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:45:28 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/console.log" append="off"/>
Nov 14 20:45:28 user nova-compute[76442]:     </serial>
Nov 14 20:45:28 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:45:28 user nova-compute[76442]:     <video>
Nov 14 20:45:28 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:45:28 user nova-compute[76442]:     </video>
Nov 14 20:45:28 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:45:28 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:45:28 user nova-compute[76442]:     </rng>
Nov 14 20:45:28 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:45:28 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:45:28 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:45:28 user nova-compute[76442]:     </memballoon>
Nov 14 20:45:28 user nova-compute[76442]:   </devices>
Nov 14 20:45:28 user nova-compute[76442]: </domain>
Nov 14 20:45:28 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172479319',display_name='tempest-ServerActionsTestOtherB-server-172479319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172479319',id=23,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1w5ZQtpg99v5QhQpY/KBiq/xXDr7VzQC2xw087O/wNCNSflAIntMOx1Fw4GV4r8zvn0kw90vwhVLFroQhtXcr2jLFgnpFnY97fquWjOk/BVWAbsopYRXAkQYhcW7Uxdw==',key_name='tempest-keypair-1429056730',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:42:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05bc76da5dd841a88a4c8bba03e288aa',ramdisk_id='',reservation_id='r-fh10qe39',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2105462622',owner_user_name='tempest-ServerActionsTestOtherB-2105462622-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497dbbf201694a4e99ba98ebb9cf8e1a',uuid=2458523e-c461-4cd5-903c-2d7ab0222162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-238515712-network", "vif_mac": "fa:16:3e:6f:d7:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converting VIF {"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-238515712-network", "vif_mac": "fa:16:3e:6f:d7:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG os_vif [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '104e645e-b74a-56b1-86e9-a7a7e14cfddc', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d5ec5ad-76, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d5ec5ad-76, col_values=(('qos', UUID('a7d75731-de40-439e-b59f-b85703f5ac29')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d5ec5ad-76, col_values=(('external_ids', {'iface-id': '9d5ec5ad-760e-438c-9e3b-b178e43f9e98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:d7:73', 'vm-uuid': '2458523e-c461-4cd5-903c-2d7ab0222162'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:28 user nova-compute[76442]: INFO os_vif [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76')
Nov 14 20:45:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] No VIF found with MAC fa:16:3e:6f:d7:73, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:45:28 user nova-compute[76442]: INFO nova.compute.claims [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Claim successful on node user
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.network.neutron [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:45:28 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:45:28 user nova-compute[76442]: DEBUG nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG nova.policy [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05ec208e91594c36a30683258c9c687d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd9ff5bbf1a49cca0d72a3ab4b34432', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:45:29 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Creating image(s)
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "/opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "/opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.200s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk 1073741824" returned: 0 in 0.048s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.223s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-b4e283c0-e08e-42da-9138-f9504adfffa3 req-829e89da-52c2-4c5f-9fb2-234b68a16e08 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b4e283c0-e08e-42da-9138-f9504adfffa3 req-829e89da-52c2-4c5f-9fb2-234b68a16e08 service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b4e283c0-e08e-42da-9138-f9504adfffa3 req-829e89da-52c2-4c5f-9fb2-234b68a16e08 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b4e283c0-e08e-42da-9138-f9504adfffa3 req-829e89da-52c2-4c5f-9fb2-234b68a16e08 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-b4e283c0-e08e-42da-9138-f9504adfffa3 req-829e89da-52c2-4c5f-9fb2-234b68a16e08 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:29 user nova-compute[76442]: WARNING nova.compute.manager [req-b4e283c0-e08e-42da-9138-f9504adfffa3 req-829e89da-52c2-4c5f-9fb2-234b68a16e08 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state active and task_state resize_finish.
Nov 14 20:45:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Cannot resize image /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Ensure instance console log exists: /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG nova.network.neutron [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Successfully created port: 090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG nova.network.neutron [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Successfully updated port: 090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "refresh_cache-9bc953e0-e107-4b67-b32a-66e6d3142f7d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquired lock "refresh_cache-9bc953e0-e107-4b67-b32a-66e6d3142f7d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG nova.network.neutron [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:45:30 user nova-compute[76442]: DEBUG nova.network.neutron [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.network.neutron [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Updating instance_info_cache with network_info: [{"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Releasing lock "refresh_cache-9bc953e0-e107-4b67-b32a-66e6d3142f7d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Instance network_info: |[{"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Start _get_guest_xml network_info=[{"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:45:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:45:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-800928174',display_name='tempest-AttachVolumeNegativeTest-server-800928174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-800928174',id=28,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcHzfeJOVxv4J47BK6c9Eoe45GTkdsDKTr9Zdfa/PcBNEVaOK1SaXA+iNb56znc+om1oGcxlBo5RN/90zCBHsrtzl84LBZBjpr1F/8H5HUBa9qykU6IMvj3D9YU4XekrQ==',key_name='tempest-keypair-1193905275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-qkmfzbzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=9bc953e0-e107-4b67-b32a-66e6d3142f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:2e,bridge_name='br-int',has_traffic_filtering=True,id=090c09ca-d26a-46e1-a42c-e31638cf31a1,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c09ca-d2') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.objects.instance [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bc953e0-e107-4b67-b32a-66e6d3142f7d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:45:31 user nova-compute[76442]:   <uuid>9bc953e0-e107-4b67-b32a-66e6d3142f7d</uuid>
Nov 14 20:45:31 user nova-compute[76442]:   <name>instance-0000001c</name>
Nov 14 20:45:31 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:45:31 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:45:31 user nova-compute[76442]:   <metadata>
Nov 14 20:45:31 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:45:31 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:45:31 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeNegativeTest-server-800928174</nova:name>
Nov 14 20:45:31 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:45:31</nova:creationTime>
Nov 14 20:45:31 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:45:31 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:45:31 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:45:31 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:45:31 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:45:31 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:45:31 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:45:31 user nova-compute[76442]:       <nova:owner>
Nov 14 20:45:31 user nova-compute[76442]:         <nova:user uuid="05ec208e91594c36a30683258c9c687d">tempest-AttachVolumeNegativeTest-1957433764-project-member</nova:user>
Nov 14 20:45:31 user nova-compute[76442]:         <nova:project uuid="5bd9ff5bbf1a49cca0d72a3ab4b34432">tempest-AttachVolumeNegativeTest-1957433764</nova:project>
Nov 14 20:45:31 user nova-compute[76442]:       </nova:owner>
Nov 14 20:45:31 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:45:31 user nova-compute[76442]:       <nova:ports>
Nov 14 20:45:31 user nova-compute[76442]:         <nova:port uuid="090c09ca-d26a-46e1-a42c-e31638cf31a1">
Nov 14 20:45:31 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 20:45:31 user nova-compute[76442]:         </nova:port>
Nov 14 20:45:31 user nova-compute[76442]:       </nova:ports>
Nov 14 20:45:31 user nova-compute[76442]:     </nova:instance>
Nov 14 20:45:31 user nova-compute[76442]:   </metadata>
Nov 14 20:45:31 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:45:31 user nova-compute[76442]:     <system>
Nov 14 20:45:31 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:45:31 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:45:31 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:45:31 user nova-compute[76442]:       <entry name="serial">9bc953e0-e107-4b67-b32a-66e6d3142f7d</entry>
Nov 14 20:45:31 user nova-compute[76442]:       <entry name="uuid">9bc953e0-e107-4b67-b32a-66e6d3142f7d</entry>
Nov 14 20:45:31 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:45:31 user nova-compute[76442]:     </system>
Nov 14 20:45:31 user nova-compute[76442]:   </sysinfo>
Nov 14 20:45:31 user nova-compute[76442]:   <os>
Nov 14 20:45:31 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:45:31 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:45:31 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:45:31 user nova-compute[76442]:   </os>
Nov 14 20:45:31 user nova-compute[76442]:   <features>
Nov 14 20:45:31 user nova-compute[76442]:     <acpi/>
Nov 14 20:45:31 user nova-compute[76442]:     <apic/>
Nov 14 20:45:31 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:45:31 user nova-compute[76442]:   </features>
Nov 14 20:45:31 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:45:31 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:45:31 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:45:31 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:45:31 user nova-compute[76442]:   </clock>
Nov 14 20:45:31 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:45:31 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:45:31 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:45:31 user nova-compute[76442]:   </cpu>
Nov 14 20:45:31 user nova-compute[76442]:   <devices>
Nov 14 20:45:31 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:45:31 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:45:31 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk"/>
Nov 14 20:45:31 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:45:31 user nova-compute[76442]:     </disk>
Nov 14 20:45:31 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:45:31 user nova-compute[76442]:       <mac address="fa:16:3e:b4:02:2e"/>
Nov 14 20:45:31 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:45:31 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:45:31 user nova-compute[76442]:       <target dev="tap090c09ca-d2"/>
Nov 14 20:45:31 user nova-compute[76442]:     </interface>
Nov 14 20:45:31 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:45:31 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/console.log" append="off"/>
Nov 14 20:45:31 user nova-compute[76442]:     </serial>
Nov 14 20:45:31 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:45:31 user nova-compute[76442]:     <video>
Nov 14 20:45:31 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:45:31 user nova-compute[76442]:     </video>
Nov 14 20:45:31 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:45:31 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:45:31 user nova-compute[76442]:     </rng>
Nov 14 20:45:31 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:45:31 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:45:31 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:45:31 user nova-compute[76442]:     </memballoon>
Nov 14 20:45:31 user nova-compute[76442]:   </devices>
Nov 14 20:45:31 user nova-compute[76442]: </domain>
Nov 14 20:45:31 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-800928174',display_name='tempest-AttachVolumeNegativeTest-server-800928174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-800928174',id=28,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcHzfeJOVxv4J47BK6c9Eoe45GTkdsDKTr9Zdfa/PcBNEVaOK1SaXA+iNb56znc+om1oGcxlBo5RN/90zCBHsrtzl84LBZBjpr1F/8H5HUBa9qykU6IMvj3D9YU4XekrQ==',key_name='tempest-keypair-1193905275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-qkmfzbzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=9bc953e0-e107-4b67-b32a-66e6d3142f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:2e,bridge_name='br-int',has_traffic_filtering=True,id=090c09ca-d26a-46e1-a42c-e31638cf31a1,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c09ca-d2') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG os_vif [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:2e,bridge_name='br-int',has_traffic_filtering=True,id=090c09ca-d26a-46e1-a42c-e31638cf31a1,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c09ca-d2') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '197366f2-1615-576c-a7a8-e43acf6a4c38', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap090c09ca-d2, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap090c09ca-d2, col_values=(('qos', UUID('3988fb0b-5790-4eeb-933d-a12efce5436d')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap090c09ca-d2, col_values=(('external_ids', {'iface-id': '090c09ca-d26a-46e1-a42c-e31638cf31a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:02:2e', 'vm-uuid': '9bc953e0-e107-4b67-b32a-66e6d3142f7d'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:31 user nova-compute[76442]: INFO os_vif [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:2e,bridge_name='br-int',has_traffic_filtering=True,id=090c09ca-d26a-46e1-a42c-e31638cf31a1,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c09ca-d2')
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No VIF found with MAC fa:16:3e:b4:02:2e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:45:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance running successfully.
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Failed to set time: agent not configured {{(pid=76442) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f6035e3a-4612-4605-a108-4b0cfb6b68a3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] finish_migration finished successfully. {{(pid=76442) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 20:45:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:32 user nova-compute[76442]: WARNING nova.compute.manager [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state resized and task_state None.
Nov 14 20:45:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received event network-changed-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Refreshing instance network info cache due to event network-changed-090c09ca-d26a-46e1-a42c-e31638cf31a1. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] Acquiring lock "refresh_cache-9bc953e0-e107-4b67-b32a-66e6d3142f7d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] Acquired lock "refresh_cache-9bc953e0-e107-4b67-b32a-66e6d3142f7d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Refreshing network info cache for port 090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Updated VIF entry in instance network info cache for port 090c09ca-d26a-46e1-a42c-e31638cf31a1. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Updating instance_info_cache with network_info: [{"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f21b21ea-3737-4bb4-80f0-193e21ee58b6 req-1e6e66ab-928e-45fe-af65-c2db4d2c3929 service nova] Releasing lock "refresh_cache-9bc953e0-e107-4b67-b32a-66e6d3142f7d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-d401adb8-fcd1-4e57-b16b-2fed0fd4079b req-594f350c-384a-4ae6-946e-48b3ab201f21 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received event network-vif-plugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d401adb8-fcd1-4e57-b16b-2fed0fd4079b req-594f350c-384a-4ae6-946e-48b3ab201f21 service nova] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d401adb8-fcd1-4e57-b16b-2fed0fd4079b req-594f350c-384a-4ae6-946e-48b3ab201f21 service nova] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d401adb8-fcd1-4e57-b16b-2fed0fd4079b req-594f350c-384a-4ae6-946e-48b3ab201f21 service nova] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-d401adb8-fcd1-4e57-b16b-2fed0fd4079b req-594f350c-384a-4ae6-946e-48b3ab201f21 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] No waiting events found dispatching network-vif-plugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:33 user nova-compute[76442]: WARNING nova.compute.manager [req-d401adb8-fcd1-4e57-b16b-2fed0fd4079b req-594f350c-384a-4ae6-946e-48b3ab201f21 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received unexpected event network-vif-plugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 for instance with vm_state building and task_state spawning.
Nov 14 20:45:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquiring lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquiring lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:33 user nova-compute[76442]: INFO nova.compute.manager [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Terminating instance
Nov 14 20:45:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Instance destroyed successfully.
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.objects.instance [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lazy-loading 'resources' on Instance uuid 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-731217489',display_name='tempest-VolumesActionsTest-instance-731217489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-731217489',id=26,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:43:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88b6b371aa054b7689bd3202c001a209',ramdisk_id='',reservation_id='r-lknkxej0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1366029594',owner_user_name='tempest-VolumesActionsTest-1366029594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:43:45Z,user_data=None,user_id='d6e5d8cd70a34f348b68641e2fa4cf74',uuid=0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Converting VIF {"id": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "address": "fa:16:3e:b1:35:69", "network": {"id": "820534ae-628c-414c-9019-17864776bd57", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2822546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b6b371aa054b7689bd3202c001a209", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f69e4e9-39", "ovs_interfaceid": "0f69e4e9-39f7-435f-8c92-f9400dd61b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:69,bridge_name='br-int',has_traffic_filtering=True,id=0f69e4e9-39f7-435f-8c92-f9400dd61b8c,network=Network(820534ae-628c-414c-9019-17864776bd57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f69e4e9-39') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG os_vif [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:69,bridge_name='br-int',has_traffic_filtering=True,id=0f69e4e9-39f7-435f-8c92-f9400dd61b8c,network=Network(820534ae-628c-414c-9019-17864776bd57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f69e4e9-39') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f69e4e9-39, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81b263d6-d177-4cdc-8cab-970df65cbdff) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:34 user nova-compute[76442]: INFO os_vif [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:69,bridge_name='br-int',has_traffic_filtering=True,id=0f69e4e9-39f7-435f-8c92-f9400dd61b8c,network=Network(820534ae-628c-414c-9019-17864776bd57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f69e4e9-39')
Nov 14 20:45:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Deleting instance files /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64_del
Nov 14 20:45:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Deletion of /opt/stack/data/nova/instances/0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64_del complete
Nov 14 20:45:34 user nova-compute[76442]: INFO nova.compute.manager [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 14 20:45:34 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:34 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Took 0.42 seconds to deallocate network for instance.
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-3707bb06-fc7b-4384-b0b5-bcecb4b8410f req-fb027d73-f41a-4891-bf99-d04e24b76ba7 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received event network-vif-deleted-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:34 user nova-compute[76442]: INFO nova.compute.manager [req-3707bb06-fc7b-4384-b0b5-bcecb4b8410f req-fb027d73-f41a-4891-bf99-d04e24b76ba7 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Neutron deleted interface 0f69e4e9-39f7-435f-8c92-f9400dd61b8c; detaching it from the instance and deleting it from the info cache
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.network.neutron [req-3707bb06-fc7b-4384-b0b5-bcecb4b8410f req-fb027d73-f41a-4891-bf99-d04e24b76ba7 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-3707bb06-fc7b-4384-b0b5-bcecb4b8410f req-fb027d73-f41a-4891-bf99-d04e24b76ba7 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Detach interface failed, port_id=0f69e4e9-39f7-435f-8c92-f9400dd61b8c, reason: Instance 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:45:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Instance spawned successfully.
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:45:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:35 user nova-compute[76442]: INFO nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 14 20:45:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:45:35 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Deleted allocations for instance 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64
Nov 14 20:45:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received event network-vif-plugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] No waiting events found dispatching network-vif-plugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:35 user nova-compute[76442]: WARNING nova.compute.manager [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received unexpected event network-vif-plugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 for instance with vm_state building and task_state spawning.
Nov 14 20:45:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received event network-vif-unplugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] Acquiring lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] No waiting events found dispatching network-vif-unplugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:35 user nova-compute[76442]: WARNING nova.compute.manager [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received unexpected event network-vif-unplugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c for instance with vm_state deleted and task_state None.
Nov 14 20:45:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received event network-vif-plugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] Acquiring lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] No waiting events found dispatching network-vif-plugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:35 user nova-compute[76442]: WARNING nova.compute.manager [req-57431423-0a86-41bb-8e02-fb8c9495a91f req-acef2a6b-2f97-44b7-b0a2-85e5c2a8feb1 service nova] [instance: 0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64] Received unexpected event network-vif-plugged-0f69e4e9-39f7-435f-8c92-f9400dd61b8c for instance with vm_state deleted and task_state None.
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8f908ee4-19cc-4364-971e-aa9c4f4d50f7 tempest-VolumesActionsTest-1366029594 tempest-VolumesActionsTest-1366029594-project-member] Lock "0383b6c5-dd0f-4a9a-89a0-71ee1e0efe64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.715s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:35 user nova-compute[76442]: INFO nova.compute.manager [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Took 6.88 seconds to build instance.
Nov 14 20:45:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-792c5141-98fb-4ad7-a954-87aadd92b325 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.980s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-69a9d4b8-a6af-4195-b258-38a1ea593676 req-4ade7005-5341-47fe-af86-054f0a27a05c service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-changed-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-69a9d4b8-a6af-4195-b258-38a1ea593676 req-4ade7005-5341-47fe-af86-054f0a27a05c service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Refreshing instance network info cache due to event network-changed-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-69a9d4b8-a6af-4195-b258-38a1ea593676 req-4ade7005-5341-47fe-af86-054f0a27a05c service nova] Acquiring lock "refresh_cache-447a1211-ebb6-4b4e-9207-047312e59f82" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-69a9d4b8-a6af-4195-b258-38a1ea593676 req-4ade7005-5341-47fe-af86-054f0a27a05c service nova] Acquired lock "refresh_cache-447a1211-ebb6-4b4e-9207-047312e59f82" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG nova.network.neutron [req-69a9d4b8-a6af-4195-b258-38a1ea593676 req-4ade7005-5341-47fe-af86-054f0a27a05c service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Refreshing network info cache for port a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG nova.objects.instance [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'flavor' on Instance uuid 447a1211-ebb6-4b4e-9207-047312e59f82 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG nova.network.neutron [req-69a9d4b8-a6af-4195-b258-38a1ea593676 req-4ade7005-5341-47fe-af86-054f0a27a05c service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Updated VIF entry in instance network info cache for port a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG nova.network.neutron [req-69a9d4b8-a6af-4195-b258-38a1ea593676 req-4ade7005-5341-47fe-af86-054f0a27a05c service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Updating instance_info_cache with network_info: [{"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-69a9d4b8-a6af-4195-b258-38a1ea593676 req-4ade7005-5341-47fe-af86-054f0a27a05c service nova] Releasing lock "refresh_cache-447a1211-ebb6-4b4e-9207-047312e59f82" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:39 user nova-compute[76442]: INFO nova.compute.manager [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Attaching volume c00d5cc3-ef46-4b65-a024-c466a8e51752 to /dev/vdb
Nov 14 20:45:39 user nova-compute[76442]: DEBUG os_brick.utils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce108182-1eb0-4d48-8022-ab8c02c751f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[be61451e-6446-4541-a8aa-bd2a82b60285]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c267fd5d-75fa-4553-b8c0-0e8eeedcc14d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8a5bfe-cdc2-4c32-bc06-1f5280ea3f62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:45:39 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:45:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3613df29-ec8a-4229-ac5b-0ace52a3957f]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG os_brick.utils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:39 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Updating existing volume attachment record: 613a8b0e-f46d-467d-9c7c-6d0395292553 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:45:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHUhNMiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:43 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:43 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:43 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2f3be8-3fcb-4f91-91fc-375ecd8c2ce5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:45:43 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9da2d-200c-4d0d-a6c3-a4344a4bd8ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752] added
Nov 14 20:45:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a8660-3cd9-4eeb-a142-44c72bc7a48f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5405af45-1784-4962-855f-66523028c9bc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHUhNMiy {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHUhNMiy" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da933f3-8381-4a15-868f-ef7d1773381e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BHUhNMiy'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed6c4ed-0f10-41d7-9bd8-b94fca4be306]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8564ecf-2d6b-4d24-8cb8-55adba1f7242]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:43 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:43 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:43 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:43 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eccbe4-28c5-4aeb-9f57-f71f7c4a788e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260]
Nov 14 20:45:44 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260] successful.
Nov 14 20:45:44 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8c5a55-58fe-4ff4-9525-0902d01fa43c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eaa1ee-cbf7-4098-8dc4-eaadce1c7711]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:44 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:44 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:44 user nova-compute[76442]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:45:44 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:44 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:44 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:44 user nova-compute[76442]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:45:44 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[540c0f52-856f-4f6c-a89b-57fb6725e4cf]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:45:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHUhNMiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:45:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:45 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23635663564636533', 'path': '/dev/sde'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635663564636533', 'path': '/dev/sde'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:45:45 user nova-compute[76442]: DEBUG nova.objects.instance [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'flavor' on Instance uuid 447a1211-ebb6-4b4e-9207-047312e59f82 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:45:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:45:45 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:45:45 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:45:45 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:45:45 user nova-compute[76442]:   <serial>c00d5cc3-ef46-4b65-a024-c466a8e51752</serial>
Nov 14 20:45:45 user nova-compute[76442]: </disk>
Nov 14 20:45:45 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:45:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No VIF found with MAC fa:16:3e:f5:74:f7, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:45:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-097cbee7-f386-4563-b42d-6e89a64d47f9 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.686s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:47 user nova-compute[76442]: INFO nova.compute.manager [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Rebuilding instance
Nov 14 20:45:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:45:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-77e8fdb9-3216-428f-9c9a-852de0d51d80 req-1f1ec7d2-8f9b-4b5d-a985-4cf3fdfc2d87 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-unplugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-77e8fdb9-3216-428f-9c9a-852de0d51d80 req-1f1ec7d2-8f9b-4b5d-a985-4cf3fdfc2d87 service nova] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-77e8fdb9-3216-428f-9c9a-852de0d51d80 req-1f1ec7d2-8f9b-4b5d-a985-4cf3fdfc2d87 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-77e8fdb9-3216-428f-9c9a-852de0d51d80 req-1f1ec7d2-8f9b-4b5d-a985-4cf3fdfc2d87 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-77e8fdb9-3216-428f-9c9a-852de0d51d80 req-1f1ec7d2-8f9b-4b5d-a985-4cf3fdfc2d87 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] No waiting events found dispatching network-vif-unplugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:47 user nova-compute[76442]: WARNING nova.compute.manager [req-77e8fdb9-3216-428f-9c9a-852de0d51d80 req-1f1ec7d2-8f9b-4b5d-a985-4cf3fdfc2d87 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received unexpected event network-vif-unplugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 for instance with vm_state active and task_state rebuilding.
Nov 14 20:45:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Instance destroyed successfully.
Nov 14 20:45:48 user nova-compute[76442]: INFO nova.compute.manager [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Detaching volume c00d5cc3-ef46-4b65-a024-c466a8e51752
Nov 14 20:45:48 user nova-compute[76442]: INFO nova.virt.block_device [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Attempting to driver detach volume c00d5cc3-ef46-4b65-a024-c466a8e51752 from mountpoint /dev/vdb
Nov 14 20:45:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Attempting to detach device vdb from instance 447a1211-ebb6-4b4e-9207-047312e59f82 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:45:48 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:45:48 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:45:48 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:45:48 user nova-compute[76442]:   <serial>c00d5cc3-ef46-4b65-a024-c466a8e51752</serial>
Nov 14 20:45:48 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:45:48 user nova-compute[76442]: </disk>
Nov 14 20:45:48 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:45:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully detached device vdb from instance 447a1211-ebb6-4b4e-9207-047312e59f82 from the persistent domain config.
Nov 14 20:45:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHUhNMiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:48 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0f2b57-f249-4252-9698-802e68af5b60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:45:48 user nova-compute[76442]: No targets found.
Nov 14 20:45:48 user nova-compute[76442]: iSNS:
Nov 14 20:45:48 user nova-compute[76442]: No targets found.
Nov 14 20:45:48 user nova-compute[76442]: STATIC:
Nov 14 20:45:48 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:45:48 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:48 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:48 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752
Nov 14 20:45:48 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:48 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:48 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f
Nov 14 20:45:48 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:48 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:48 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:45:48 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:48 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:48 user nova-compute[76442]: FIRMWARE:
Nov 14 20:45:48 user nova-compute[76442]: No targets found.
Nov 14 20:45:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:45:48 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:45:48 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[223ad5df-fcb0-4bbb-921e-fa20d6d1b70c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb12adc-7313-4b04-a55c-b87c2bbc3aa7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:48 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:48 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:48 user nova-compute[76442]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:45:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:48 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:48 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:48 user nova-compute[76442]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:45:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4d7a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752'): ({'sde'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Removing single pathed devices sde {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a8aff0-41f9-47eb-94ff-9ba42af519de]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[962b6e8a-ec98-4b25-8593-eaade042004a]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flushing IO for device /dev/sde {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c0d3da-39fa-4275-91d6-c957666c9928]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[130e7c85-9a40-4d8f-b538-1c3031d9d759]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b2e2e-e588-4bbe-b095-b30bc2f94a9c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77fc8c7-8b30-42ac-a5ab-72ba1a809fb5]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260]
Nov 14 20:45:48 user nova-compute[76442]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260] successful.
Nov 14 20:45:48 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b02250-0eee-4269-818a-acd826a4aa4d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== disconnect_volume: return (301ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Instance destroyed successfully.
Nov 14 20:45:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-499867076',display_name='tempest-ServerActionsTestOtherA-server-831548993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-499867076',id=27,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhvsEZC0bcnfS2UzsdizcTnu8K63xeTSWXSenE88qW4P2SVk+A6XJuerbfkhGBUpnBKQwDTJWQX3TBjWO9boLSj04YxQKsAqQ5X4QfVYbLp9D569QPjJG8Agn490Q7bnw==',key_name='tempest-keypair-1495363036',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:43:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-caelltby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=447a1211-ebb6-4b4e-9207-047312e59f82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_vif [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa883b6df-bc, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a15748f4-aff7-4811-a140-7a559191f8ef) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:49 user nova-compute[76442]: INFO os_vif [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc')
Nov 14 20:45:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHUhNMiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:49 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8881e4f-5a47-4135-bed2-2491cc536e69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:45:49 user nova-compute[76442]: No targets found.
Nov 14 20:45:49 user nova-compute[76442]: iSNS:
Nov 14 20:45:49 user nova-compute[76442]: No targets found.
Nov 14 20:45:49 user nova-compute[76442]: STATIC:
Nov 14 20:45:49 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:45:49 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:49 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:49 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f
Nov 14 20:45:49 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:49 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:49 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:45:49 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:45:49 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:45:49 user nova-compute[76442]: FIRMWARE:
Nov 14 20:45:49 user nova-compute[76442]: No targets found.
Nov 14 20:45:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:45:49 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:45:49 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aab2f4-9694-475a-b9f4-be0f2d0ac5dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae20041b-0121-483e-8042-6673db10b48b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:49 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:49 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:49 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:49 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4de2320>, {}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Disconnecting from: [] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== disconnect_volume: return (70ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:45:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Deleting instance files /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82_del
Nov 14 20:45:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Deletion of /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82_del complete
Nov 14 20:45:49 user nova-compute[76442]: INFO nova.virt.block_device [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Booting with volume c00d5cc3-ef46-4b65-a024-c466a8e51752 at /dev/vdb
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.utils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bb1add-e884-47a6-8857-e67b7b8fd454]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f9d09c-f2f6-4655-a231-afc7ec8f30e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-331290bb-af1a-49a9-8dfd-fae1c9f029de req-96ef98dc-31f0-4afe-9d7a-2f8c878ad895 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-331290bb-af1a-49a9-8dfd-fae1c9f029de req-96ef98dc-31f0-4afe-9d7a-2f8c878ad895 service nova] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-331290bb-af1a-49a9-8dfd-fae1c9f029de req-96ef98dc-31f0-4afe-9d7a-2f8c878ad895 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-331290bb-af1a-49a9-8dfd-fae1c9f029de req-96ef98dc-31f0-4afe-9d7a-2f8c878ad895 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-331290bb-af1a-49a9-8dfd-fae1c9f029de req-96ef98dc-31f0-4afe-9d7a-2f8c878ad895 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] No waiting events found dispatching network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:49 user nova-compute[76442]: WARNING nova.compute.manager [req-331290bb-af1a-49a9-8dfd-fae1c9f029de req-96ef98dc-31f0-4afe-9d7a-2f8c878ad895 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received unexpected event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[23815013-45b6-4cdd-9816-e02c2b59e5e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8257c181-7010-4da0-9db4-f41ec9b95673]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:45:49 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:45:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dea03d-6515-48af-8e4e-2ba2dd9ab69a]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG os_brick.utils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:49 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Updating existing volume attachment record: a5877013-402d-4d33-91ca-7953e2fec7ea {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:45:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:45:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Creating image(s)
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk 1073741824" returned: 0 in 0.052s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:45:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Cannot resize image /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Ensure instance console log exists: /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Start _get_guest_xml network_info=[{"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHUhNMiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '447a1211-ebb6-4b4e-9207-047312e59f82', 'attached_at': '', 'detached_at': '', 'volume_id': 'c00d5cc3-ef46-4b65-a024-c466a8e51752', 'serial': 'c00d5cc3-ef46-4b65-a024-c466a8e51752'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'attachment_id': 'a5877013-402d-4d33-91ca-7953e2fec7ea', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:45:55 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 20:45:55 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.objects.instance [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'vcpu_model' on Instance uuid 447a1211-ebb6-4b4e-9207-047312e59f82 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHUhNMiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:45:55 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:55 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:45:55 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f8453-d216-4da3-85ef-3e24f34f260a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:45:55 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:45:55 user nova-compute[76442]: INFO nova.compute.claims [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Claim successful on node user
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f00ea1-6ba3-4909-a09d-51111b343d08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752] added
Nov 14 20:45:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7478cf17-847e-4c8f-b0db-611928d4683b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ca60fe-6451-4913-9341-efac75cae6e1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHUhNMiy {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BHUhNMiy" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e051847e-4306-499e-a9c1-aa64f4b90cd9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BHUhNMiy'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51df0cf-b7d5-41bc-8a20-d88c9c35b7ae]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9371291b-a18f-4f72-96e2-fd6f0fe93e0f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb567f86-0986-48b0-bf68-21c022248af1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260]
Nov 14 20:45:55 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260] successful.
Nov 14 20:45:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[514ea64f-496c-443d-851d-1f7620e2312c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a406ee-dd27-4362-a75e-5dec6b0e70c3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:45:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:45:55 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:45:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1003b9a-4fa1-4ae8-af1f-e6275749b161]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHUhNMiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.network.neutron [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:45:55 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.policy [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1451459113e244e798fff66799c10c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1e7d9ec7d5342a797576c7e568c1073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:45:55 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Creating image(s)
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "/opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "/opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk 1073741824" returned: 0 in 0.053s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23635663564636533', 'path': '/dev/sde'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635663564636533', 'path': '/dev/sde'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-499867076',display_name='tempest-ServerActionsTestOtherA-server-831548993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-499867076',id=27,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhvsEZC0bcnfS2UzsdizcTnu8K63xeTSWXSenE88qW4P2SVk+A6XJuerbfkhGBUpnBKQwDTJWQX3TBjWO9boLSj04YxQKsAqQ5X4QfVYbLp9D569QPjJG8Agn490Q7bnw==',key_name='tempest-keypair-1495363036',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:43:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-caelltby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=447a1211-ebb6-4b4e-9207-047312e59f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:45:56 user nova-compute[76442]:   <uuid>447a1211-ebb6-4b4e-9207-047312e59f82</uuid>
Nov 14 20:45:56 user nova-compute[76442]:   <name>instance-0000001b</name>
Nov 14 20:45:56 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:45:56 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:45:56 user nova-compute[76442]:   <metadata>
Nov 14 20:45:56 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:45:56 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:45:56 user nova-compute[76442]:       <nova:name>tempest-ServerActionsTestOtherA-server-831548993</nova:name>
Nov 14 20:45:56 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:45:55</nova:creationTime>
Nov 14 20:45:56 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:45:56 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:45:56 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:45:56 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:45:56 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:45:56 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:45:56 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:45:56 user nova-compute[76442]:       <nova:owner>
Nov 14 20:45:56 user nova-compute[76442]:         <nova:user uuid="3b873835b5e341c5aebfd4ded5f2c093">tempest-ServerActionsTestOtherA-887472165-project-member</nova:user>
Nov 14 20:45:56 user nova-compute[76442]:         <nova:project uuid="265a9c8786db48c78145d1388a5c321f">tempest-ServerActionsTestOtherA-887472165</nova:project>
Nov 14 20:45:56 user nova-compute[76442]:       </nova:owner>
Nov 14 20:45:56 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:45:56 user nova-compute[76442]:       <nova:ports>
Nov 14 20:45:56 user nova-compute[76442]:         <nova:port uuid="a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7">
Nov 14 20:45:56 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:45:56 user nova-compute[76442]:         </nova:port>
Nov 14 20:45:56 user nova-compute[76442]:       </nova:ports>
Nov 14 20:45:56 user nova-compute[76442]:     </nova:instance>
Nov 14 20:45:56 user nova-compute[76442]:   </metadata>
Nov 14 20:45:56 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:45:56 user nova-compute[76442]:     <system>
Nov 14 20:45:56 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:45:56 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:45:56 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:45:56 user nova-compute[76442]:       <entry name="serial">447a1211-ebb6-4b4e-9207-047312e59f82</entry>
Nov 14 20:45:56 user nova-compute[76442]:       <entry name="uuid">447a1211-ebb6-4b4e-9207-047312e59f82</entry>
Nov 14 20:45:56 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:45:56 user nova-compute[76442]:     </system>
Nov 14 20:45:56 user nova-compute[76442]:   </sysinfo>
Nov 14 20:45:56 user nova-compute[76442]:   <os>
Nov 14 20:45:56 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:45:56 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:45:56 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:45:56 user nova-compute[76442]:   </os>
Nov 14 20:45:56 user nova-compute[76442]:   <features>
Nov 14 20:45:56 user nova-compute[76442]:     <acpi/>
Nov 14 20:45:56 user nova-compute[76442]:     <apic/>
Nov 14 20:45:56 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:45:56 user nova-compute[76442]:   </features>
Nov 14 20:45:56 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:45:56 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:45:56 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:45:56 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:45:56 user nova-compute[76442]:   </clock>
Nov 14 20:45:56 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:45:56 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:45:56 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:45:56 user nova-compute[76442]:   </cpu>
Nov 14 20:45:56 user nova-compute[76442]:   <devices>
Nov 14 20:45:56 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:45:56 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:45:56 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk"/>
Nov 14 20:45:56 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:45:56 user nova-compute[76442]:     </disk>
Nov 14 20:45:56 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:45:56 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:45:56 user nova-compute[76442]:       <source dev="/dev/sde"/>
Nov 14 20:45:56 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:45:56 user nova-compute[76442]:       <serial>c00d5cc3-ef46-4b65-a024-c466a8e51752</serial>
Nov 14 20:45:56 user nova-compute[76442]:     </disk>
Nov 14 20:45:56 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:45:56 user nova-compute[76442]:       <mac address="fa:16:3e:f5:74:f7"/>
Nov 14 20:45:56 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:45:56 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:45:56 user nova-compute[76442]:       <target dev="tapa883b6df-bc"/>
Nov 14 20:45:56 user nova-compute[76442]:     </interface>
Nov 14 20:45:56 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:45:56 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/console.log" append="off"/>
Nov 14 20:45:56 user nova-compute[76442]:     </serial>
Nov 14 20:45:56 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:45:56 user nova-compute[76442]:     <video>
Nov 14 20:45:56 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:45:56 user nova-compute[76442]:     </video>
Nov 14 20:45:56 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:45:56 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:45:56 user nova-compute[76442]:     </rng>
Nov 14 20:45:56 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:45:56 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:45:56 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:45:56 user nova-compute[76442]:     </memballoon>
Nov 14 20:45:56 user nova-compute[76442]:   </devices>
Nov 14 20:45:56 user nova-compute[76442]: </domain>
Nov 14 20:45:56 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-499867076',display_name='tempest-ServerActionsTestOtherA-server-831548993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-499867076',id=27,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhvsEZC0bcnfS2UzsdizcTnu8K63xeTSWXSenE88qW4P2SVk+A6XJuerbfkhGBUpnBKQwDTJWQX3TBjWO9boLSj04YxQKsAqQ5X4QfVYbLp9D569QPjJG8Agn490Q7bnw==',key_name='tempest-keypair-1495363036',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:43:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-caelltby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=447a1211-ebb6-4b4e-9207-047312e59f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG os_vif [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.network.neutron [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Successfully created port: 4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '432bfc24-ff31-506a-a6de-d8482f70f3e3', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa883b6df-bc, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa883b6df-bc, col_values=(('qos', UUID('9c901127-d808-4401-9158-d201afd825f6')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa883b6df-bc, col_values=(('external_ids', {'iface-id': 'a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:74:f7', 'vm-uuid': '447a1211-ebb6-4b4e-9207-047312e59f82'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:56 user nova-compute[76442]: INFO os_vif [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc')
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No VIF found with MAC fa:16:3e:f5:74:f7, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Cannot resize image /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Ensure instance console log exists: /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Successfully updated port: 4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "refresh_cache-4fbe4b37-bb70-4858-b79e-b44bab71cc02" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquired lock "refresh_cache-4fbe4b37-bb70-4858-b79e-b44bab71cc02" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-49d83979-182c-4185-bdb9-9edf6550e106 req-74de5e11-cadb-422c-bc49-d22d0664657a service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received event network-changed-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-49d83979-182c-4185-bdb9-9edf6550e106 req-74de5e11-cadb-422c-bc49-d22d0664657a service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Refreshing instance network info cache due to event network-changed-4c21af8e-263d-47b2-827d-3c9c63c06ef9. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-49d83979-182c-4185-bdb9-9edf6550e106 req-74de5e11-cadb-422c-bc49-d22d0664657a service nova] Acquiring lock "refresh_cache-4fbe4b37-bb70-4858-b79e-b44bab71cc02" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Updating instance_info_cache with network_info: [{"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Releasing lock "refresh_cache-4fbe4b37-bb70-4858-b79e-b44bab71cc02" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Instance network_info: |[{"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-49d83979-182c-4185-bdb9-9edf6550e106 req-74de5e11-cadb-422c-bc49-d22d0664657a service nova] Acquired lock "refresh_cache-4fbe4b37-bb70-4858-b79e-b44bab71cc02" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-49d83979-182c-4185-bdb9-9edf6550e106 req-74de5e11-cadb-422c-bc49-d22d0664657a service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Refreshing network info cache for port 4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Start _get_guest_xml network_info=[{"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:45:57 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:45:57 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-923105165',display_name='tempest-AttachVolumeTestJSON-server-923105165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-923105165',id=29,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo/bddgzApVpimsORBLTKgfPLNA4u8eBRkhBhMA+YD11qELb7te3KrbyenM6XWaf/BHgBb/4w/xun1XD5yfNnk1kjfRfIjHv1QBO5foZe5O006lr5MIondfwf5CJ1sNZw==',key_name='tempest-keypair-1367332533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-xnv9f604',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=4fbe4b37-bb70-4858-b79e-b44bab71cc02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0a:7d,bridge_name='br-int',has_traffic_filtering=True,id=4c21af8e-263d-47b2-827d-3c9c63c06ef9,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c21af8e-26') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.objects.instance [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:45:57 user nova-compute[76442]:   <uuid>4fbe4b37-bb70-4858-b79e-b44bab71cc02</uuid>
Nov 14 20:45:57 user nova-compute[76442]:   <name>instance-0000001d</name>
Nov 14 20:45:57 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:45:57 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:45:57 user nova-compute[76442]:   <metadata>
Nov 14 20:45:57 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:45:57 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:45:57 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeTestJSON-server-923105165</nova:name>
Nov 14 20:45:57 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:45:57</nova:creationTime>
Nov 14 20:45:57 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:45:57 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:45:57 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:45:57 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:45:57 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:45:57 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:45:57 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:45:57 user nova-compute[76442]:       <nova:owner>
Nov 14 20:45:57 user nova-compute[76442]:         <nova:user uuid="1451459113e244e798fff66799c10c48">tempest-AttachVolumeTestJSON-650801364-project-member</nova:user>
Nov 14 20:45:57 user nova-compute[76442]:         <nova:project uuid="b1e7d9ec7d5342a797576c7e568c1073">tempest-AttachVolumeTestJSON-650801364</nova:project>
Nov 14 20:45:57 user nova-compute[76442]:       </nova:owner>
Nov 14 20:45:57 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:45:57 user nova-compute[76442]:       <nova:ports>
Nov 14 20:45:57 user nova-compute[76442]:         <nova:port uuid="4c21af8e-263d-47b2-827d-3c9c63c06ef9">
Nov 14 20:45:57 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 20:45:57 user nova-compute[76442]:         </nova:port>
Nov 14 20:45:57 user nova-compute[76442]:       </nova:ports>
Nov 14 20:45:57 user nova-compute[76442]:     </nova:instance>
Nov 14 20:45:57 user nova-compute[76442]:   </metadata>
Nov 14 20:45:57 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:45:57 user nova-compute[76442]:     <system>
Nov 14 20:45:57 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:45:57 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:45:57 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:45:57 user nova-compute[76442]:       <entry name="serial">4fbe4b37-bb70-4858-b79e-b44bab71cc02</entry>
Nov 14 20:45:57 user nova-compute[76442]:       <entry name="uuid">4fbe4b37-bb70-4858-b79e-b44bab71cc02</entry>
Nov 14 20:45:57 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:45:57 user nova-compute[76442]:     </system>
Nov 14 20:45:57 user nova-compute[76442]:   </sysinfo>
Nov 14 20:45:57 user nova-compute[76442]:   <os>
Nov 14 20:45:57 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:45:57 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:45:57 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:45:57 user nova-compute[76442]:   </os>
Nov 14 20:45:57 user nova-compute[76442]:   <features>
Nov 14 20:45:57 user nova-compute[76442]:     <acpi/>
Nov 14 20:45:57 user nova-compute[76442]:     <apic/>
Nov 14 20:45:57 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:45:57 user nova-compute[76442]:   </features>
Nov 14 20:45:57 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:45:57 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:45:57 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:45:57 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:45:57 user nova-compute[76442]:   </clock>
Nov 14 20:45:57 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:45:57 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:45:57 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:45:57 user nova-compute[76442]:   </cpu>
Nov 14 20:45:57 user nova-compute[76442]:   <devices>
Nov 14 20:45:57 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:45:57 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:45:57 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk"/>
Nov 14 20:45:57 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:45:57 user nova-compute[76442]:     </disk>
Nov 14 20:45:57 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:45:57 user nova-compute[76442]:       <mac address="fa:16:3e:1c:0a:7d"/>
Nov 14 20:45:57 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:45:57 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:45:57 user nova-compute[76442]:       <target dev="tap4c21af8e-26"/>
Nov 14 20:45:57 user nova-compute[76442]:     </interface>
Nov 14 20:45:57 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:45:57 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/console.log" append="off"/>
Nov 14 20:45:57 user nova-compute[76442]:     </serial>
Nov 14 20:45:57 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:45:57 user nova-compute[76442]:     <video>
Nov 14 20:45:57 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:45:57 user nova-compute[76442]:     </video>
Nov 14 20:45:57 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:45:57 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:45:57 user nova-compute[76442]:     </rng>
Nov 14 20:45:57 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:45:57 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:45:57 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:45:57 user nova-compute[76442]:     </memballoon>
Nov 14 20:45:57 user nova-compute[76442]:   </devices>
Nov 14 20:45:57 user nova-compute[76442]: </domain>
Nov 14 20:45:57 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-923105165',display_name='tempest-AttachVolumeTestJSON-server-923105165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-923105165',id=29,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo/bddgzApVpimsORBLTKgfPLNA4u8eBRkhBhMA+YD11qELb7te3KrbyenM6XWaf/BHgBb/4w/xun1XD5yfNnk1kjfRfIjHv1QBO5foZe5O006lr5MIondfwf5CJ1sNZw==',key_name='tempest-keypair-1367332533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-xnv9f604',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:45:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=4fbe4b37-bb70-4858-b79e-b44bab71cc02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0a:7d,bridge_name='br-int',has_traffic_filtering=True,id=4c21af8e-263d-47b2-827d-3c9c63c06ef9,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c21af8e-26') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG os_vif [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0a:7d,bridge_name='br-int',has_traffic_filtering=True,id=4c21af8e-263d-47b2-827d-3c9c63c06ef9,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c21af8e-26') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f94ebeea-c333-52a7-838d-ce88ee151a4d', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c21af8e-26, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c21af8e-26, col_values=(('qos', UUID('a4c616ac-3f75-4cc8-8b11-ca4858ce8fcd')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c21af8e-26, col_values=(('external_ids', {'iface-id': '4c21af8e-263d-47b2-827d-3c9c63c06ef9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:0a:7d', 'vm-uuid': '4fbe4b37-bb70-4858-b79e-b44bab71cc02'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:57 user nova-compute[76442]: INFO os_vif [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:0a:7d,bridge_name='br-int',has_traffic_filtering=True,id=4c21af8e-263d-47b2-827d-3c9c63c06ef9,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c21af8e-26')
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:45:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No VIF found with MAC fa:16:3e:1c:0a:7d, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-49d83979-182c-4185-bdb9-9edf6550e106 req-74de5e11-cadb-422c-bc49-d22d0664657a service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Updated VIF entry in instance network info cache for port 4c21af8e-263d-47b2-827d-3c9c63c06ef9. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-49d83979-182c-4185-bdb9-9edf6550e106 req-74de5e11-cadb-422c-bc49-d22d0664657a service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Updating instance_info_cache with network_info: [{"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-49d83979-182c-4185-bdb9-9edf6550e106 req-74de5e11-cadb-422c-bc49-d22d0664657a service nova] Releasing lock "refresh_cache-4fbe4b37-bb70-4858-b79e-b44bab71cc02" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-d6282ac5-680b-44a6-9412-a81ed1f2049d req-53572ad2-bdb0-49a0-bd23-2a64717ba8a1 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d6282ac5-680b-44a6-9412-a81ed1f2049d req-53572ad2-bdb0-49a0-bd23-2a64717ba8a1 service nova] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d6282ac5-680b-44a6-9412-a81ed1f2049d req-53572ad2-bdb0-49a0-bd23-2a64717ba8a1 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d6282ac5-680b-44a6-9412-a81ed1f2049d req-53572ad2-bdb0-49a0-bd23-2a64717ba8a1 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-d6282ac5-680b-44a6-9412-a81ed1f2049d req-53572ad2-bdb0-49a0-bd23-2a64717ba8a1 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] No waiting events found dispatching network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:58 user nova-compute[76442]: WARNING nova.compute.manager [req-d6282ac5-680b-44a6-9412-a81ed1f2049d req-53572ad2-bdb0-49a0-bd23-2a64717ba8a1 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received unexpected event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 20:45:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 20:45:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 20:45:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:45:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-a946fe6d-6540-43af-9def-0e99a41bf456 req-1bd04a42-0f27-4812-ac07-9ea4594b5af8 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received event network-vif-plugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:45:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a946fe6d-6540-43af-9def-0e99a41bf456 req-1bd04a42-0f27-4812-ac07-9ea4594b5af8 service nova] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:45:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a946fe6d-6540-43af-9def-0e99a41bf456 req-1bd04a42-0f27-4812-ac07-9ea4594b5af8 service nova] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:45:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a946fe6d-6540-43af-9def-0e99a41bf456 req-1bd04a42-0f27-4812-ac07-9ea4594b5af8 service nova] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:45:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-a946fe6d-6540-43af-9def-0e99a41bf456 req-1bd04a42-0f27-4812-ac07-9ea4594b5af8 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] No waiting events found dispatching network-vif-plugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:45:59 user nova-compute[76442]: WARNING nova.compute.manager [req-a946fe6d-6540-43af-9def-0e99a41bf456 req-1bd04a42-0f27-4812-ac07-9ea4594b5af8 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received unexpected event network-vif-plugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 for instance with vm_state building and task_state spawning.
Nov 14 20:46:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-4144f25c-6975-40e2-a8e6-915740055c52 req-38eb66fc-2a35-4cb2-8a54-b40ea4069432 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4144f25c-6975-40e2-a8e6-915740055c52 req-38eb66fc-2a35-4cb2-8a54-b40ea4069432 service nova] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4144f25c-6975-40e2-a8e6-915740055c52 req-38eb66fc-2a35-4cb2-8a54-b40ea4069432 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4144f25c-6975-40e2-a8e6-915740055c52 req-38eb66fc-2a35-4cb2-8a54-b40ea4069432 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-4144f25c-6975-40e2-a8e6-915740055c52 req-38eb66fc-2a35-4cb2-8a54-b40ea4069432 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] No waiting events found dispatching network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:00 user nova-compute[76442]: WARNING nova.compute.manager [req-4144f25c-6975-40e2-a8e6-915740055c52 req-38eb66fc-2a35-4cb2-8a54-b40ea4069432 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received unexpected event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 20:46:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:46:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Instance spawned successfully.
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.objects.instance [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76442) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b3921652-c7a7-416a-9b74-93ed5db92196 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:46:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Instance spawned successfully.
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-fb5ac0b3-d6bb-4e1d-852f-ac6b5c0373a9 req-4dd5b7ce-b638-41e6-8787-23704c30c820 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received event network-vif-plugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fb5ac0b3-d6bb-4e1d-852f-ac6b5c0373a9 req-4dd5b7ce-b638-41e6-8787-23704c30c820 service nova] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fb5ac0b3-d6bb-4e1d-852f-ac6b5c0373a9 req-4dd5b7ce-b638-41e6-8787-23704c30c820 service nova] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fb5ac0b3-d6bb-4e1d-852f-ac6b5c0373a9 req-4dd5b7ce-b638-41e6-8787-23704c30c820 service nova] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-fb5ac0b3-d6bb-4e1d-852f-ac6b5c0373a9 req-4dd5b7ce-b638-41e6-8787-23704c30c820 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] No waiting events found dispatching network-vif-plugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:02 user nova-compute[76442]: WARNING nova.compute.manager [req-fb5ac0b3-d6bb-4e1d-852f-ac6b5c0373a9 req-4dd5b7ce-b638-41e6-8787-23704c30c820 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received unexpected event network-vif-plugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 for instance with vm_state building and task_state spawning.
Nov 14 20:46:02 user nova-compute[76442]: INFO nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 14 20:46:02 user nova-compute[76442]: DEBUG nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:46:02 user nova-compute[76442]: INFO nova.compute.manager [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Took 6.87 seconds to build instance.
Nov 14 20:46:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-27ed1718-2bd0-4add-921d-3e7ca55c7630 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.035s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:02 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:03 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:03 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:46:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:09 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:46:09 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:46:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7504MB free_disk=25.1558837890625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:46:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Applying migration context for instance 2458523e-c461-4cd5-903c-2d7ab0222162 as it has an incoming, in-progress migration e25a099f-4abf-4657-9a70-e8a9e6c07f7e. Migration status is finished {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 20:46:09 user nova-compute[76442]: INFO nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating resource usage from migration e25a099f-4abf-4657-9a70-e8a9e6c07f7e
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 31c7399a-07f6-40d7-a62c-8fa374193ba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 3b28c6e1-5191-48fd-be07-d1af671b0695 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 88dd9488-e777-4b33-9702-e8f0353a62c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 447a1211-ebb6-4b4e-9207-047312e59f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Migration e25a099f-4abf-4657-9a70-e8a9e6c07f7e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2458523e-c461-4cd5-903c-2d7ab0222162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.893s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:10 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 20:46:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:46:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:46:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:46:12 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:46:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updating instance_info_cache with network_info: [{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:46:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:46:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:46:13 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:46:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:22 user nova-compute[76442]: INFO nova.compute.manager [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Terminating instance
Nov 14 20:46:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-9550570f-7587-46b5-9ca6-80e8be1a8ffe req-254eb36d-befb-4e52-b2bb-f10bef85d99d service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-unplugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9550570f-7587-46b5-9ca6-80e8be1a8ffe req-254eb36d-befb-4e52-b2bb-f10bef85d99d service nova] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9550570f-7587-46b5-9ca6-80e8be1a8ffe req-254eb36d-befb-4e52-b2bb-f10bef85d99d service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9550570f-7587-46b5-9ca6-80e8be1a8ffe req-254eb36d-befb-4e52-b2bb-f10bef85d99d service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-9550570f-7587-46b5-9ca6-80e8be1a8ffe req-254eb36d-befb-4e52-b2bb-f10bef85d99d service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] No waiting events found dispatching network-vif-unplugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-9550570f-7587-46b5-9ca6-80e8be1a8ffe req-254eb36d-befb-4e52-b2bb-f10bef85d99d service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-unplugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Instance destroyed successfully.
Nov 14 20:46:22 user nova-compute[76442]: DEBUG nova.objects.instance [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lazy-loading 'resources' on Instance uuid 3b28c6e1-5191-48fd-be07-d1af671b0695 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-592433099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-45726840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY9gZC8aB/JVqRnz6O+jEJIYx3p8DCBh9I7CmcOwY/m7HTA/XQPaLwT4ucWvMGkpa+45IFG/yxglKz5lQd7V/yRTk6SXIoIm2npdlarA3QE1Y1entI5IU/P4Rc/W1pfyQ==',key_name='tempest-keypair-1596655746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:44:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ce7cf07105a4357920a0e48d02e38f4',ramdisk_id='',reservation_id='r-jexecte0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1273726129',owner_user_name='tempest-ServerActionsV293TestJSON-1273726129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6972c92678b245978e9692d3a75da62d',uuid=3b28c6e1-5191-48fd-be07-d1af671b0695,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converting VIF {"id": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "address": "fa:16:3e:a9:83:be", "network": {"id": "482cb0f3-f726-4d54-a209-3b9d9e423e05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-233730104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce7cf07105a4357920a0e48d02e38f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8ed0c1-0d", "ovs_interfaceid": "fb8ed0c1-0dd9-4677-b881-904340c8fbf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG os_vif [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb8ed0c1-0d, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfc0a16f-f5b7-4580-b9ae-576236973dda) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:22 user nova-compute[76442]: INFO os_vif [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:83:be,bridge_name='br-int',has_traffic_filtering=True,id=fb8ed0c1-0dd9-4677-b881-904340c8fbf5,network=Network(482cb0f3-f726-4d54-a209-3b9d9e423e05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8ed0c1-0d')
Nov 14 20:46:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRtcSXzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:46:22 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:46:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7456848f-6287-4dee-bbd7-57a68d645c76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:46:22 user nova-compute[76442]: No targets found.
Nov 14 20:46:22 user nova-compute[76442]: iSNS:
Nov 14 20:46:22 user nova-compute[76442]: No targets found.
Nov 14 20:46:22 user nova-compute[76442]: STATIC:
Nov 14 20:46:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:46:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:46:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:46:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752
Nov 14 20:46:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:46:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:46:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f
Nov 14 20:46:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:46:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:46:22 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:46:22 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:46:22 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:46:22 user nova-compute[76442]: FIRMWARE:
Nov 14 20:46:22 user nova-compute[76442]: No targets found.
Nov 14 20:46:22 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:46:22 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:46:22 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:46:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe632a-7fe0-4c15-b90c-82663515e7a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[861b9d5f-506a-4436-b77c-982897208741]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:46:23 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:46:23 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:46:23 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:46:23 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:46:23 user nova-compute[76442]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f (non-flash)
Nov 14 20:46:23 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:46:23 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:46:23 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4dbf370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b27f4-115d-4948-8af4-19048e450dfc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b767311-8658-4b3e-8b86-7b03175ebd39]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3555fd14-3173-4131-90c6-eea9b3598a18]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c782e59-95c8-470e-ba4a-50d893a129ea]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9500c64f-edfb5e45e1ec716d', '/dev/disk/by-id/scsi-26564666235653435', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9500c64f') {{(pid=87657) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[965c07bb-0e3e-4728-9c89-36f84ea86acf]: (4, None) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0629689e-b8dd-4fef-83b5-db8105b0d5bf]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79f2f01-9093-44cd-a358-6c99b6c2c3f1]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260]
Nov 14 20:46:23 user nova-compute[76442]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f, portal: 172.16.0.220,3260] successful.
Nov 14 20:46:23 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c8788c-116f-4c6d-9a69-e6ebd291f72f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1901009-622f-479c-bcf9-9fbd6df2e857]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] <== disconnect_volume: return (348ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:46:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Deleting instance files /opt/stack/data/nova/instances/3b28c6e1-5191-48fd-be07-d1af671b0695_del
Nov 14 20:46:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Deletion of /opt/stack/data/nova/instances/3b28c6e1-5191-48fd-be07-d1af671b0695_del complete
Nov 14 20:46:23 user nova-compute[76442]: INFO nova.compute.manager [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:46:23 user nova-compute[76442]: INFO nova.compute.manager [None req-e7bec1b1-e681-4efa-8ba0-221d07c3b979 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Unrescuing
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e7bec1b1-e681-4efa-8ba0-221d07c3b979 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e7bec1b1-e681-4efa-8ba0-221d07c3b979 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquired lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e7bec1b1-e681-4efa-8ba0-221d07c3b979 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e7bec1b1-e681-4efa-8ba0-221d07c3b979 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updating instance_info_cache with network_info: [{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e7bec1b1-e681-4efa-8ba0-221d07c3b979 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Releasing lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e7bec1b1-e681-4efa-8ba0-221d07c3b979 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'flavor' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-35e03b02-33cb-458e-919e-0ea83874b293 req-f7981593-c017-430f-99c9-e7df44eeab05 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-unplugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-35e03b02-33cb-458e-919e-0ea83874b293 req-f7981593-c017-430f-99c9-e7df44eeab05 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-35e03b02-33cb-458e-919e-0ea83874b293 req-f7981593-c017-430f-99c9-e7df44eeab05 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-35e03b02-33cb-458e-919e-0ea83874b293 req-f7981593-c017-430f-99c9-e7df44eeab05 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-35e03b02-33cb-458e-919e-0ea83874b293 req-f7981593-c017-430f-99c9-e7df44eeab05 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-unplugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:24 user nova-compute[76442]: WARNING nova.compute.manager [req-35e03b02-33cb-458e-919e-0ea83874b293 req-f7981593-c017-430f-99c9-e7df44eeab05 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-unplugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:46:24 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:24 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Took 0.79 seconds to deallocate network for instance.
Nov 14 20:46:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:24 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Instance destroyed successfully.
Nov 14 20:46:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-4edbc4af-6f0d-4288-92e1-ac1274d33cf4 req-b0c88a6a-b2f7-40c9-9c06-ed67163310f5 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4edbc4af-6f0d-4288-92e1-ac1274d33cf4 req-b0c88a6a-b2f7-40c9-9c06-ed67163310f5 service nova] Acquiring lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4edbc4af-6f0d-4288-92e1-ac1274d33cf4 req-b0c88a6a-b2f7-40c9-9c06-ed67163310f5 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4edbc4af-6f0d-4288-92e1-ac1274d33cf4 req-b0c88a6a-b2f7-40c9-9c06-ed67163310f5 service nova] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-4edbc4af-6f0d-4288-92e1-ac1274d33cf4 req-b0c88a6a-b2f7-40c9-9c06-ed67163310f5 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] No waiting events found dispatching network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:24 user nova-compute[76442]: WARNING nova.compute.manager [req-4edbc4af-6f0d-4288-92e1-ac1274d33cf4 req-b0c88a6a-b2f7-40c9-9c06-ed67163310f5 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received unexpected event network-vif-plugged-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 for instance with vm_state active and task_state deleting.
Nov 14 20:46:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-4edbc4af-6f0d-4288-92e1-ac1274d33cf4 req-b0c88a6a-b2f7-40c9-9c06-ed67163310f5 service nova] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Received event network-vif-deleted-fb8ed0c1-0dd9-4677-b881-904340c8fbf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:25 user nova-compute[76442]: INFO nova.compute.manager [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Took 0.92 seconds to detach 1 volumes for instance.
Nov 14 20:46:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] [instance: 3b28c6e1-5191-48fd-be07-d1af671b0695] Deleting volume: 69c8788c-116f-4c6d-9a69-e6ebd291f72f {{(pid=76442) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:25 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Deleted allocations for instance 3b28c6e1-5191-48fd-be07-d1af671b0695
Nov 14 20:46:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b2087a-83ba-40ff-b8ff-7e0a87892266 tempest-ServerActionsV293TestJSON-1273726129 tempest-ServerActionsV293TestJSON-1273726129-project-member] Lock "3b28c6e1-5191-48fd-be07-d1af671b0695" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.792s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-264bf8aa-f465-45d7-bc44-b3cb0cea3031 req-89d16c60-dfd0-411d-b8db-17d16623ce75 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-264bf8aa-f465-45d7-bc44-b3cb0cea3031 req-89d16c60-dfd0-411d-b8db-17d16623ce75 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-264bf8aa-f465-45d7-bc44-b3cb0cea3031 req-89d16c60-dfd0-411d-b8db-17d16623ce75 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-264bf8aa-f465-45d7-bc44-b3cb0cea3031 req-89d16c60-dfd0-411d-b8db-17d16623ce75 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-264bf8aa-f465-45d7-bc44-b3cb0cea3031 req-89d16c60-dfd0-411d-b8db-17d16623ce75 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:26 user nova-compute[76442]: WARNING nova.compute.manager [req-264bf8aa-f465-45d7-bc44-b3cb0cea3031 req-89d16c60-dfd0-411d-b8db-17d16623ce75 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:46:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:46:26 user nova-compute[76442]: INFO nova.compute.claims [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Claim successful on node user
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:46:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:26 user nova-compute[76442]: DEBUG nova.policy [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4163211b006c4fbbbdc575c0e6d02ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83568ed733848d09643843927ca0c42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:46:26 user nova-compute[76442]: INFO nova.virt.block_device [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Booting with volume-backed-image c456f24a-ee5e-4551-88d7-a8348db880df at /dev/vda
Nov 14 20:46:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Successfully created port: ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:46:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e7bec1b1-e681-4efa-8ba0-221d07c3b979 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.network.neutron [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Successfully updated port: ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquired lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.network.neutron [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-1a6da200-2404-4883-b37b-a1a1a7cff366 req-03219830-931c-4ef2-bfcf-6265be38d888 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-changed-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-1a6da200-2404-4883-b37b-a1a1a7cff366 req-03219830-931c-4ef2-bfcf-6265be38d888 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Refreshing instance network info cache due to event network-changed-ea6754df-28fe-4491-aaa4-a9c27388944a. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1a6da200-2404-4883-b37b-a1a1a7cff366 req-03219830-931c-4ef2-bfcf-6265be38d888 service nova] Acquiring lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:28 user nova-compute[76442]: WARNING nova.compute.manager [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state active and task_state None.
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:28 user nova-compute[76442]: WARNING nova.compute.manager [req-a46772d1-aabf-46d3-adfa-27a1c51dcf1e req-e4b175e0-2f3b-4201-bb5a-2b5b3a20393e service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state active and task_state None.
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.network.neutron [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.network.neutron [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Updating instance_info_cache with network_info: [{"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Releasing lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Instance network_info: |[{"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1a6da200-2404-4883-b37b-a1a1a7cff366 req-03219830-931c-4ef2-bfcf-6265be38d888 service nova] Acquired lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-1a6da200-2404-4883-b37b-a1a1a7cff366 req-03219830-931c-4ef2-bfcf-6265be38d888 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Refreshing network info cache for port ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-1a6da200-2404-4883-b37b-a1a1a7cff366 req-03219830-931c-4ef2-bfcf-6265be38d888 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Updated VIF entry in instance network info cache for port ea6754df-28fe-4491-aaa4-a9c27388944a. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-1a6da200-2404-4883-b37b-a1a1a7cff366 req-03219830-931c-4ef2-bfcf-6265be38d888 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Updating instance_info_cache with network_info: [{"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:46:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1a6da200-2404-4883-b37b-a1a1a7cff366 req-03219830-931c-4ef2-bfcf-6265be38d888 service nova] Releasing lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:46:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG os_brick.utils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c90a9b-e84d-4936-87d0-2188fa9345d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7a2a0f-c0ac-4207-8f98-e854265d7112]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[60225bf5-75c4-4fb8-a7ae-5bbe20c55f72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e226ad-318f-4a69-97b1-a66593e163f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:46:32 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:46:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[13195fda-5f1b-4e4f-b6e1-45f78d2bb492]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG os_brick.utils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Updating existing volume attachment record: 3de2559c-95c8-4bf2-91c7-4b8457383a92 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:46:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:46:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Creating image(s)
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Ensure instance console log exists: /opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Start _get_guest_xml network_info=[{"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyNfxHRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4aaca85e-1424-4feb-af15-a7d320fe0a18', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 'serial': 'd7c5a374-7a0a-4164-b59a-f5f0a6987cf3'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '3de2559c-95c8-4bf2-91c7-4b8457383a92', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:46:37 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:46:37 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyNfxHRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:46:37 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:46:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:46:37 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:46:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:46:37 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:46:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75d35d1-10f6-42ba-8132-f79f1ee70490]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:46:37 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d33d53a-3791-4f60-a60b-1b95c88c5a4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3] added
Nov 14 20:46:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[261d0514-0310-4d4e-8d67-97a1bdb99014]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54cbf4f-90ef-4869-8166-74d9e079ac63]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyNfxHRQ {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyNfxHRQ" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[371f0186-a0b8-4f4b-af91-a8532c0cab39]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dyNfxHRQ'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac2f2f-227b-4e80-8bf8-8f8bb21ec969]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[494fbc8e-e211-46d6-b923-b926052afe0d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb186a7c-5999-4f7d-9509-4d5d7bf36c1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3, portal: 172.16.0.220,3260]
Nov 14 20:46:38 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3, portal: 172.16.0.220,3260] successful.
Nov 14 20:46:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d13e96-dc53-4186-a66b-edcfcc256d13]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b165b12a-9d5c-47db-9248-b2fa1f7474f0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:46:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc30bb18-8d5b-4e19-8e6c-0476007f1792]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:46:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyNfxHRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23539333966373661', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539333966373661', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1978269637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1978269637',id=30,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-jqc0ymvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:46:27Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=4aaca85e-1424-4feb-af15-a7d320fe0a18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:46:73,bridge_name='br-int',has_traffic_filtering=True,id=ea6754df-28fe-4491-aaa4-a9c27388944a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6754df-28') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.objects.instance [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'pci_devices' on Instance uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:46:39 user nova-compute[76442]:   <uuid>4aaca85e-1424-4feb-af15-a7d320fe0a18</uuid>
Nov 14 20:46:39 user nova-compute[76442]:   <name>instance-0000001e</name>
Nov 14 20:46:39 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:46:39 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:46:39 user nova-compute[76442]:   <metadata>
Nov 14 20:46:39 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:46:39 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:46:39 user nova-compute[76442]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1978269637</nova:name>
Nov 14 20:46:39 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:46:37</nova:creationTime>
Nov 14 20:46:39 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:46:39 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:46:39 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:46:39 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:46:39 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:46:39 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:46:39 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:46:39 user nova-compute[76442]:       <nova:owner>
Nov 14 20:46:39 user nova-compute[76442]:         <nova:user uuid="4163211b006c4fbbbdc575c0e6d02ac8">tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member</nova:user>
Nov 14 20:46:39 user nova-compute[76442]:         <nova:project uuid="f83568ed733848d09643843927ca0c42">tempest-ServerBootFromVolumeStableRescueTest-1547619353</nova:project>
Nov 14 20:46:39 user nova-compute[76442]:       </nova:owner>
Nov 14 20:46:39 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:46:39 user nova-compute[76442]:       <nova:ports>
Nov 14 20:46:39 user nova-compute[76442]:         <nova:port uuid="ea6754df-28fe-4491-aaa4-a9c27388944a">
Nov 14 20:46:39 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:46:39 user nova-compute[76442]:         </nova:port>
Nov 14 20:46:39 user nova-compute[76442]:       </nova:ports>
Nov 14 20:46:39 user nova-compute[76442]:     </nova:instance>
Nov 14 20:46:39 user nova-compute[76442]:   </metadata>
Nov 14 20:46:39 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:46:39 user nova-compute[76442]:     <system>
Nov 14 20:46:39 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:46:39 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:46:39 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:46:39 user nova-compute[76442]:       <entry name="serial">4aaca85e-1424-4feb-af15-a7d320fe0a18</entry>
Nov 14 20:46:39 user nova-compute[76442]:       <entry name="uuid">4aaca85e-1424-4feb-af15-a7d320fe0a18</entry>
Nov 14 20:46:39 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:46:39 user nova-compute[76442]:     </system>
Nov 14 20:46:39 user nova-compute[76442]:   </sysinfo>
Nov 14 20:46:39 user nova-compute[76442]:   <os>
Nov 14 20:46:39 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:46:39 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:46:39 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:46:39 user nova-compute[76442]:   </os>
Nov 14 20:46:39 user nova-compute[76442]:   <features>
Nov 14 20:46:39 user nova-compute[76442]:     <acpi/>
Nov 14 20:46:39 user nova-compute[76442]:     <apic/>
Nov 14 20:46:39 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:46:39 user nova-compute[76442]:   </features>
Nov 14 20:46:39 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:46:39 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:46:39 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:46:39 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:46:39 user nova-compute[76442]:   </clock>
Nov 14 20:46:39 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:46:39 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:46:39 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:46:39 user nova-compute[76442]:   </cpu>
Nov 14 20:46:39 user nova-compute[76442]:   <devices>
Nov 14 20:46:39 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:46:39 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:46:39 user nova-compute[76442]:       <source dev="/dev/sdc"/>
Nov 14 20:46:39 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:46:39 user nova-compute[76442]:       <serial>d7c5a374-7a0a-4164-b59a-f5f0a6987cf3</serial>
Nov 14 20:46:39 user nova-compute[76442]:     </disk>
Nov 14 20:46:39 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:46:39 user nova-compute[76442]:       <mac address="fa:16:3e:49:46:73"/>
Nov 14 20:46:39 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:46:39 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:46:39 user nova-compute[76442]:       <target dev="tapea6754df-28"/>
Nov 14 20:46:39 user nova-compute[76442]:     </interface>
Nov 14 20:46:39 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:46:39 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/console.log" append="off"/>
Nov 14 20:46:39 user nova-compute[76442]:     </serial>
Nov 14 20:46:39 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:46:39 user nova-compute[76442]:     <video>
Nov 14 20:46:39 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:46:39 user nova-compute[76442]:     </video>
Nov 14 20:46:39 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:46:39 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:46:39 user nova-compute[76442]:     </rng>
Nov 14 20:46:39 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:46:39 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:46:39 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:46:39 user nova-compute[76442]:     </memballoon>
Nov 14 20:46:39 user nova-compute[76442]:   </devices>
Nov 14 20:46:39 user nova-compute[76442]: </domain>
Nov 14 20:46:39 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1978269637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1978269637',id=30,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-jqc0ymvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:46:27Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=4aaca85e-1424-4feb-af15-a7d320fe0a18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:46:73,bridge_name='br-int',has_traffic_filtering=True,id=ea6754df-28fe-4491-aaa4-a9c27388944a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6754df-28') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG os_vif [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:46:73,bridge_name='br-int',has_traffic_filtering=True,id=ea6754df-28fe-4491-aaa4-a9c27388944a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6754df-28') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f82a0452-d57e-5909-ac98-7e7101a89f06', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea6754df-28, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea6754df-28, col_values=(('qos', UUID('a2ae8c24-6d14-4e8d-849b-356bdd873384')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea6754df-28, col_values=(('external_ids', {'iface-id': 'ea6754df-28fe-4491-aaa4-a9c27388944a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:46:73', 'vm-uuid': '4aaca85e-1424-4feb-af15-a7d320fe0a18'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:39 user nova-compute[76442]: INFO os_vif [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:46:73,bridge_name='br-int',has_traffic_filtering=True,id=ea6754df-28fe-4491-aaa4-a9c27388944a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6754df-28')
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:46:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No VIF found with MAC fa:16:3e:49:46:73, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-3c503e0a-a05a-4ebd-bcbf-cb8f6391f13c req-d2efd71b-b244-4d47-bfb5-37bd701b0bce service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3c503e0a-a05a-4ebd-bcbf-cb8f6391f13c req-d2efd71b-b244-4d47-bfb5-37bd701b0bce service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3c503e0a-a05a-4ebd-bcbf-cb8f6391f13c req-d2efd71b-b244-4d47-bfb5-37bd701b0bce service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3c503e0a-a05a-4ebd-bcbf-cb8f6391f13c req-d2efd71b-b244-4d47-bfb5-37bd701b0bce service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-3c503e0a-a05a-4ebd-bcbf-cb8f6391f13c req-d2efd71b-b244-4d47-bfb5-37bd701b0bce service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:40 user nova-compute[76442]: WARNING nova.compute.manager [req-3c503e0a-a05a-4ebd-bcbf-cb8f6391f13c req-d2efd71b-b244-4d47-bfb5-37bd701b0bce service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state building and task_state spawning.
Nov 14 20:46:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:46:42 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Instance spawned successfully.
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:46:42 user nova-compute[76442]: INFO nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-f99d9264-8a54-4cfe-ab2f-be90dc58722e req-e9b20712-5f83-434e-9b8b-33f1d8be8128 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f99d9264-8a54-4cfe-ab2f-be90dc58722e req-e9b20712-5f83-434e-9b8b-33f1d8be8128 service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f99d9264-8a54-4cfe-ab2f-be90dc58722e req-e9b20712-5f83-434e-9b8b-33f1d8be8128 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f99d9264-8a54-4cfe-ab2f-be90dc58722e req-e9b20712-5f83-434e-9b8b-33f1d8be8128 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-f99d9264-8a54-4cfe-ab2f-be90dc58722e req-e9b20712-5f83-434e-9b8b-33f1d8be8128 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:46:42 user nova-compute[76442]: WARNING nova.compute.manager [req-f99d9264-8a54-4cfe-ab2f-be90dc58722e req-e9b20712-5f83-434e-9b8b-33f1d8be8128 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state building and task_state spawning.
Nov 14 20:46:42 user nova-compute[76442]: INFO nova.compute.manager [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Took 16.64 seconds to build instance.
Nov 14 20:46:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-703ea02f-eef7-4943-bcb2-cf99ad084d49 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.995s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:46:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:46:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:03 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Port 9d5ec5ad-760e-438c-9e3b-b178e43f9e98 binding to destination host user is already ACTIVE {{(pid=76442) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquired lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:47:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating instance_info_cache with network_info: [{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Releasing lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Creating tmpfile /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/tmpyj0ynyxu to verify with other compute node that the instance is on the same shared storage. {{(pid=76442) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-8b701be1-4dab-4d49-89d8-36bd7ccdf625 req-75d305a8-7cf2-4bf3-9120-94c7509aa936 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-unplugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8b701be1-4dab-4d49-89d8-36bd7ccdf625 req-75d305a8-7cf2-4bf3-9120-94c7509aa936 service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8b701be1-4dab-4d49-89d8-36bd7ccdf625 req-75d305a8-7cf2-4bf3-9120-94c7509aa936 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8b701be1-4dab-4d49-89d8-36bd7ccdf625 req-75d305a8-7cf2-4bf3-9120-94c7509aa936 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-8b701be1-4dab-4d49-89d8-36bd7ccdf625 req-75d305a8-7cf2-4bf3-9120-94c7509aa936 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-unplugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:47:06 user nova-compute[76442]: WARNING nova.compute.manager [req-8b701be1-4dab-4d49-89d8-36bd7ccdf625 req-75d305a8-7cf2-4bf3-9120-94c7509aa936 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-unplugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state resized and task_state resize_reverting.
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance destroyed successfully.
Nov 14 20:47:07 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lazy-loading 'resources' on Instance uuid 2458523e-c461-4cd5-903c-2d7ab0222162 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172479319',display_name='tempest-ServerActionsTestOtherB-server-172479319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172479319',id=23,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1w5ZQtpg99v5QhQpY/KBiq/xXDr7VzQC2xw087O/wNCNSflAIntMOx1Fw4GV4r8zvn0kw90vwhVLFroQhtXcr2jLFgnpFnY97fquWjOk/BVWAbsopYRXAkQYhcW7Uxdw==',key_name='tempest-keypair-1429056730',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:45:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05bc76da5dd841a88a4c8bba03e288aa',ramdisk_id='',reservation_id='r-fh10qe39',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2105462622',owner_user_name='tempest-ServerActionsTestOtherB-2105462622-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:45:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497dbbf201694a4e99ba98ebb9cf8e1a',uuid=2458523e-c461-4cd5-903c-2d7ab0222162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converting VIF {"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_vif [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d5ec5ad-76, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7d75731-de40-439e-b59f-b85703f5ac29) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:47:07 user nova-compute[76442]: INFO os_vif [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76')
Nov 14 20:47:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:47:07 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[73564afb-1b01-4160-94b4-7946e40ce3c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:47:07 user nova-compute[76442]: No targets found.
Nov 14 20:47:07 user nova-compute[76442]: iSNS:
Nov 14 20:47:07 user nova-compute[76442]: No targets found.
Nov 14 20:47:07 user nova-compute[76442]: STATIC:
Nov 14 20:47:07 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:47:07 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:47:07 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:47:07 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:47:07 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:47:07 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:47:07 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752
Nov 14 20:47:07 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:47:07 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:47:07 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:47:07 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:47:07 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:47:07 user nova-compute[76442]: FIRMWARE:
Nov 14 20:47:07 user nova-compute[76442]: No targets found.
Nov 14 20:47:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:47:07 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:47:07 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e96aba-a6b9-4b15-8f7d-d28088a69d69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe7439f-f2e7-4fe0-8766-da6df945e856]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:07 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:07 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:07 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:07 user nova-compute[76442]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:07 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:07 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e8738a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.074s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a76626-965d-4f86-ae04-b7e9c19b6d61]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2bec57-6663-4e34-9a35-a0ab396d48f9]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1781d7a2-9bae-4f98-99cb-0cff1d38ddc2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f456c63-c76e-49c2-991a-3c79b0c031e4]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eca88db-548f-46f8-8758-0758e92d2459]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a085ed4b-866b-4c8a-a5e2-8d495b8251e7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]
Nov 14 20:47:07 user nova-compute[76442]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.
Nov 14 20:47:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2ce1c3-ac48-4dd7-9be1-2ad3f77e9458]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.490s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] <== disconnect_volume: return (492ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:47:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-d4bf6f85-b6ba-4ee2-848a-918b3b0f7096 req-d5e011f8-a63c-4dc4-a332-aed616910f97 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d4bf6f85-b6ba-4ee2-848a-918b3b0f7096 req-d5e011f8-a63c-4dc4-a332-aed616910f97 service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d4bf6f85-b6ba-4ee2-848a-918b3b0f7096 req-d5e011f8-a63c-4dc4-a332-aed616910f97 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d4bf6f85-b6ba-4ee2-848a-918b3b0f7096 req-d5e011f8-a63c-4dc4-a332-aed616910f97 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-d4bf6f85-b6ba-4ee2-848a-918b3b0f7096 req-d5e011f8-a63c-4dc4-a332-aed616910f97 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:47:08 user nova-compute[76442]: WARNING nova.compute.manager [req-d4bf6f85-b6ba-4ee2-848a-918b3b0f7096 req-d5e011f8-a63c-4dc4-a332-aed616910f97 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state resized and task_state resize_reverting.
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lazy-loading 'migration_context' on Instance uuid 2458523e-c461-4cd5-903c-2d7ab0222162 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:08 user nova-compute[76442]: DEBUG nova.objects.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Object Instance<2458523e-c461-4cd5-903c-2d7ab0222162> lazy-loaded attributes: resources,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:09 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:47:09 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7291MB free_disk=25.087806701660156GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.847s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.323s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 31c7399a-07f6-40d7-a62c-8fa374193ba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 88dd9488-e777-4b33-9702-e8f0353a62c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 447a1211-ebb6-4b4e-9207-047312e59f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: INFO nova.compute.manager [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Swapping old allocation on dict_keys(['8fc56580-8aa8-4b89-aaa5-43465a1eed3f']) held by migration e25a099f-4abf-4657-9a70-e8a9e6c07f7e for instance
Nov 14 20:47:09 user nova-compute[76442]: INFO nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e25a099f-4abf-4657-9a70-e8a9e6c07f7e has allocations against this compute host but is not found in the database.
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2458523e-c461-4cd5-903c-2d7ab0222162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 4aaca85e-1424-4feb-af15-a7d320fe0a18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:47:09 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Overwriting current allocation {'allocations': {'8fc56580-8aa8-4b89-aaa5-43465a1eed3f': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': '05bc76da5dd841a88a4c8bba03e288aa', 'user_id': '497dbbf201694a4e99ba98ebb9cf8e1a', 'consumer_generation': 1} on consumer 2458523e-c461-4cd5-903c-2d7ab0222162 {{(pid=76442) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquired lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating instance_info_cache with network_info: [{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Releasing lock "refresh_cache-2458523e-c461-4cd5-903c-2d7ab0222162" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG os_brick.utils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ae54bf-8b78-4973-aada-5528a975bbce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0602f-2bcc-41ed-b297-2e956d16f885]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e7f5e-34e2-4dda-96df-bb57213a3d74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[feac0a37-1524-4f2a-a309-72a8bdbe5eb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:47:10 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:47:10 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d176e-00a5-404b-86f7-799970030e6f]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:47:10 user nova-compute[76442]: DEBUG os_brick.utils [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Updating instance_info_cache with network_info: [{"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:47:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:47:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Starting finish_revert_migration {{(pid=76442) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Start _get_guest_xml network_info=[{"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2458523e-c461-4cd5-903c-2d7ab0222162', 'attached_at': '2023-11-14T20:47:16.000000', 'detached_at': '', 'volume_id': '4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'serial': '4e45b5f2-cc4b-4abd-b79b-64187c75978a'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'attachment_id': 'a766a954-0e89-4c41-9dd3-77c70125de37', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:47:16 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:47:16 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2458523e-c461-4cd5-903c-2d7ab0222162 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:47:16 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:47:16 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:47:16 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f25a16-12c9-411a-bdb4-42d9c6628154]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:47:16 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[064d0234-20c7-407a-8a98-0ee2b97a0573]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a] added
Nov 14 20:47:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb10ccf-1ce7-4e77-b64f-0e155f69cda2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[31657f92-5321-4463-b01c-5fb4a38ab8d2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQFbkNXl {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQFbkNXl" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1902eab5-2b12-469c-9d44-5da0fa68af78]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rQFbkNXl'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cabb94a-04a0-4cff-9ca2-9c08a73c166b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6024d6-5595-4319-becd-54946eb0c624]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1b67b1-13d1-476e-a9bc-cc72751d4209]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]
Nov 14 20:47:16 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.
Nov 14 20:47:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0915dac-6447-4ae9-bce9-a509146d16be]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[652a94e3-caf2-4983-9142-c20a96fee5e3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:16 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce75eef-0c0c-4291-b285-c9ccccc26559]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:47:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23136656466633737', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136656466633737', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172479319',display_name='tempest-ServerActionsTestOtherB-server-172479319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172479319',id=23,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1w5ZQtpg99v5QhQpY/KBiq/xXDr7VzQC2xw087O/wNCNSflAIntMOx1Fw4GV4r8zvn0kw90vwhVLFroQhtXcr2jLFgnpFnY97fquWjOk/BVWAbsopYRXAkQYhcW7Uxdw==',key_name='tempest-keypair-1429056730',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:45:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05bc76da5dd841a88a4c8bba03e288aa',ramdisk_id='',reservation_id='r-fh10qe39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2105462622',owner_user_name='tempest-ServerActionsTestOtherB-2105462622-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497dbbf201694a4e99ba98ebb9cf8e1a',uuid=2458523e-c461-4cd5-903c-2d7ab0222162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converting VIF {"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:47:17 user nova-compute[76442]:   <uuid>2458523e-c461-4cd5-903c-2d7ab0222162</uuid>
Nov 14 20:47:17 user nova-compute[76442]:   <name>instance-00000017</name>
Nov 14 20:47:17 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:47:17 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:47:17 user nova-compute[76442]:   <metadata>
Nov 14 20:47:17 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:47:17 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:47:17 user nova-compute[76442]:       <nova:name>tempest-ServerActionsTestOtherB-server-172479319</nova:name>
Nov 14 20:47:17 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:47:16</nova:creationTime>
Nov 14 20:47:17 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:47:17 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:47:17 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:47:17 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:47:17 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:47:17 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:47:17 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:47:17 user nova-compute[76442]:       <nova:owner>
Nov 14 20:47:17 user nova-compute[76442]:         <nova:user uuid="497dbbf201694a4e99ba98ebb9cf8e1a">tempest-ServerActionsTestOtherB-2105462622-project-member</nova:user>
Nov 14 20:47:17 user nova-compute[76442]:         <nova:project uuid="05bc76da5dd841a88a4c8bba03e288aa">tempest-ServerActionsTestOtherB-2105462622</nova:project>
Nov 14 20:47:17 user nova-compute[76442]:       </nova:owner>
Nov 14 20:47:17 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:47:17 user nova-compute[76442]:       <nova:ports>
Nov 14 20:47:17 user nova-compute[76442]:         <nova:port uuid="9d5ec5ad-760e-438c-9e3b-b178e43f9e98">
Nov 14 20:47:17 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 20:47:17 user nova-compute[76442]:         </nova:port>
Nov 14 20:47:17 user nova-compute[76442]:       </nova:ports>
Nov 14 20:47:17 user nova-compute[76442]:     </nova:instance>
Nov 14 20:47:17 user nova-compute[76442]:   </metadata>
Nov 14 20:47:17 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:47:17 user nova-compute[76442]:     <system>
Nov 14 20:47:17 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:47:17 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:47:17 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:47:17 user nova-compute[76442]:       <entry name="serial">2458523e-c461-4cd5-903c-2d7ab0222162</entry>
Nov 14 20:47:17 user nova-compute[76442]:       <entry name="uuid">2458523e-c461-4cd5-903c-2d7ab0222162</entry>
Nov 14 20:47:17 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:47:17 user nova-compute[76442]:     </system>
Nov 14 20:47:17 user nova-compute[76442]:   </sysinfo>
Nov 14 20:47:17 user nova-compute[76442]:   <os>
Nov 14 20:47:17 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:47:17 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:47:17 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:47:17 user nova-compute[76442]:   </os>
Nov 14 20:47:17 user nova-compute[76442]:   <features>
Nov 14 20:47:17 user nova-compute[76442]:     <acpi/>
Nov 14 20:47:17 user nova-compute[76442]:     <apic/>
Nov 14 20:47:17 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:47:17 user nova-compute[76442]:   </features>
Nov 14 20:47:17 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:47:17 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:47:17 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:47:17 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:47:17 user nova-compute[76442]:   </clock>
Nov 14 20:47:17 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:47:17 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:47:17 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:47:17 user nova-compute[76442]:   </cpu>
Nov 14 20:47:17 user nova-compute[76442]:   <devices>
Nov 14 20:47:17 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:47:17 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:47:17 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk"/>
Nov 14 20:47:17 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:47:17 user nova-compute[76442]:     </disk>
Nov 14 20:47:17 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:47:17 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:47:17 user nova-compute[76442]:       <source dev="/dev/sdd"/>
Nov 14 20:47:17 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:47:17 user nova-compute[76442]:       <serial>4e45b5f2-cc4b-4abd-b79b-64187c75978a</serial>
Nov 14 20:47:17 user nova-compute[76442]:     </disk>
Nov 14 20:47:17 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:47:17 user nova-compute[76442]:       <mac address="fa:16:3e:6f:d7:73"/>
Nov 14 20:47:17 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:47:17 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:47:17 user nova-compute[76442]:       <target dev="tap9d5ec5ad-76"/>
Nov 14 20:47:17 user nova-compute[76442]:     </interface>
Nov 14 20:47:17 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:47:17 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/console.log" append="off"/>
Nov 14 20:47:17 user nova-compute[76442]:     </serial>
Nov 14 20:47:17 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:47:17 user nova-compute[76442]:     <video>
Nov 14 20:47:17 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:47:17 user nova-compute[76442]:     </video>
Nov 14 20:47:17 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:47:17 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:47:17 user nova-compute[76442]:     </rng>
Nov 14 20:47:17 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:47:17 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:47:17 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:47:17 user nova-compute[76442]:     </memballoon>
Nov 14 20:47:17 user nova-compute[76442]:   </devices>
Nov 14 20:47:17 user nova-compute[76442]: </domain>
Nov 14 20:47:17 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172479319',display_name='tempest-ServerActionsTestOtherB-server-172479319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172479319',id=23,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1w5ZQtpg99v5QhQpY/KBiq/xXDr7VzQC2xw087O/wNCNSflAIntMOx1Fw4GV4r8zvn0kw90vwhVLFroQhtXcr2jLFgnpFnY97fquWjOk/BVWAbsopYRXAkQYhcW7Uxdw==',key_name='tempest-keypair-1429056730',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:45:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='05bc76da5dd841a88a4c8bba03e288aa',ramdisk_id='',reservation_id='r-fh10qe39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2105462622',owner_user_name='tempest-ServerActionsTestOtherB-2105462622-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497dbbf201694a4e99ba98ebb9cf8e1a',uuid=2458523e-c461-4cd5-903c-2d7ab0222162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converting VIF {"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG os_vif [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '104e645e-b74a-56b1-86e9-a7a7e14cfddc', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d5ec5ad-76, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d5ec5ad-76, col_values=(('qos', UUID('827ced81-b00f-4254-82d5-de5fa0cfe2a0')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d5ec5ad-76, col_values=(('external_ids', {'iface-id': '9d5ec5ad-760e-438c-9e3b-b178e43f9e98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:d7:73', 'vm-uuid': '2458523e-c461-4cd5-903c-2d7ab0222162'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:47:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:17 user nova-compute[76442]: INFO os_vif [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76')
Nov 14 20:47:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-a8f66211-670e-4209-9b5e-6b339075da56 req-143dd9a1-2184-417c-87c5-7b513cc2b410 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a8f66211-670e-4209-9b5e-6b339075da56 req-143dd9a1-2184-417c-87c5-7b513cc2b410 service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a8f66211-670e-4209-9b5e-6b339075da56 req-143dd9a1-2184-417c-87c5-7b513cc2b410 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a8f66211-670e-4209-9b5e-6b339075da56 req-143dd9a1-2184-417c-87c5-7b513cc2b410 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-a8f66211-670e-4209-9b5e-6b339075da56 req-143dd9a1-2184-417c-87c5-7b513cc2b410 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:47:19 user nova-compute[76442]: WARNING nova.compute.manager [req-a8f66211-670e-4209-9b5e-6b339075da56 req-143dd9a1-2184-417c-87c5-7b513cc2b410 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state resized and task_state resize_reverting.
Nov 14 20:47:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-39a2147d-dfdf-4a6e-a6cb-07913ddd7be2 req-c4f46a6f-bd55-443d-a339-391cb17f1616 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received event network-changed-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-39a2147d-dfdf-4a6e-a6cb-07913ddd7be2 req-c4f46a6f-bd55-443d-a339-391cb17f1616 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Refreshing instance network info cache due to event network-changed-090c09ca-d26a-46e1-a42c-e31638cf31a1. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-39a2147d-dfdf-4a6e-a6cb-07913ddd7be2 req-c4f46a6f-bd55-443d-a339-391cb17f1616 service nova] Acquiring lock "refresh_cache-9bc953e0-e107-4b67-b32a-66e6d3142f7d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-39a2147d-dfdf-4a6e-a6cb-07913ddd7be2 req-c4f46a6f-bd55-443d-a339-391cb17f1616 service nova] Acquired lock "refresh_cache-9bc953e0-e107-4b67-b32a-66e6d3142f7d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG nova.network.neutron [req-39a2147d-dfdf-4a6e-a6cb-07913ddd7be2 req-c4f46a6f-bd55-443d-a339-391cb17f1616 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Refreshing network info cache for port 090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG nova.network.neutron [req-39a2147d-dfdf-4a6e-a6cb-07913ddd7be2 req-c4f46a6f-bd55-443d-a339-391cb17f1616 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Updated VIF entry in instance network info cache for port 090c09ca-d26a-46e1-a42c-e31638cf31a1. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG nova.network.neutron [req-39a2147d-dfdf-4a6e-a6cb-07913ddd7be2 req-c4f46a6f-bd55-443d-a339-391cb17f1616 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Updating instance_info_cache with network_info: [{"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:47:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-39a2147d-dfdf-4a6e-a6cb-07913ddd7be2 req-c4f46a6f-bd55-443d-a339-391cb17f1616 service nova] Releasing lock "refresh_cache-9bc953e0-e107-4b67-b32a-66e6d3142f7d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:47:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:47:21 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance running successfully.
Nov 14 20:47:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] finish_revert_migration finished successfully. {{(pid=76442) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 20:47:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-a9373955-28d8-4b44-b78f-c84922f67cfe req-ede68663-3922-44d9-ba5c-0798292e3ac9 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:47:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a9373955-28d8-4b44-b78f-c84922f67cfe req-ede68663-3922-44d9-ba5c-0798292e3ac9 service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a9373955-28d8-4b44-b78f-c84922f67cfe req-ede68663-3922-44d9-ba5c-0798292e3ac9 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a9373955-28d8-4b44-b78f-c84922f67cfe req-ede68663-3922-44d9-ba5c-0798292e3ac9 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-a9373955-28d8-4b44-b78f-c84922f67cfe req-ede68663-3922-44d9-ba5c-0798292e3ac9 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:47:21 user nova-compute[76442]: WARNING nova.compute.manager [req-a9373955-28d8-4b44-b78f-c84922f67cfe req-ede68663-3922-44d9-ba5c-0798292e3ac9 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state resized and task_state resize_reverting.
Nov 14 20:47:21 user nova-compute[76442]: INFO nova.compute.manager [None req-e2d5a24f-c4d0-4cac-a6ab-08505f53af1c tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating instance to original state: 'active'
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG nova.objects.instance [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'flavor' on Instance uuid 9bc953e0-e107-4b67-b32a-66e6d3142f7d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:22 user nova-compute[76442]: INFO nova.compute.manager [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Attaching volume 008864cd-8a1b-4c01-9e6d-019ccb215ac6 to /dev/vdb
Nov 14 20:47:22 user nova-compute[76442]: DEBUG os_brick.utils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2983f3fc-6d7d-49a7-bb6d-d848a97aa16c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2ecb03-2181-4afe-a8ec-fc4f9dcc0425]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb17fd9-9c67-473c-8f23-dfbf11387a66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb573d76-c1eb-491f-9c21-37b0656b66d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:47:22 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:47:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0990fc-091d-4438-a886-7b9390b2093d]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG os_brick.utils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Updating existing volume attachment record: 5d31b0e4-be94-4f74-83ec-a873f4ccf288 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:47:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DwqkYZNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:47:27 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:47:27 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:47:27 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca6196d-bd5f-45e7-b6db-ca083876d47a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:47:27 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e9353-7caf-467d-8d85-12302dc4af76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6] added
Nov 14 20:47:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc24a52-07c0-46d3-a9d5-ae1af80c7602]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fd50d5-023c-4402-b8a0-6f471d70e41f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DwqkYZNg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DwqkYZNg" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b6eb4b-2baa-4a61-9e39-4732efdea889]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DwqkYZNg'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6953cd84-4dde-4187-bda2-8899962c6482]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[947827f1-649a-4e0c-9415-a653a13b688b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00e581c-1e1d-4d53-8070-258936a21db6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6, portal: 172.16.0.220,3260]
Nov 14 20:47:28 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6, portal: 172.16.0.220,3260] successful.
Nov 14 20:47:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf7dad9-e063-4142-a6e1-e1d11b7016e7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c99e67-fab7-4dba-baf4-276153cdaf74]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:28 user nova-compute[76442]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 (non-flash)
Nov 14 20:47:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[736521f7-b1e9-4445-bdd5-3ae165e5e7ea]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:47:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DwqkYZNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:47:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:47:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26138636164633037', 'path': '/dev/sdf'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:47:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138636164633037', 'path': '/dev/sdf'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:47:29 user nova-compute[76442]: DEBUG nova.objects.instance [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'flavor' on Instance uuid 9bc953e0-e107-4b67-b32a-66e6d3142f7d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:47:29 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:47:29 user nova-compute[76442]:   <source dev="/dev/sdf"/>
Nov 14 20:47:29 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:47:29 user nova-compute[76442]:   <serial>008864cd-8a1b-4c01-9e6d-019ccb215ac6</serial>
Nov 14 20:47:29 user nova-compute[76442]: </disk>
Nov 14 20:47:29 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:47:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:47:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:47:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] No VIF found with MAC fa:16:3e:b4:02:2e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:47:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-22b1f452-dcdb-4856-9159-38713a606b44 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.652s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:31 user nova-compute[76442]: INFO nova.compute.manager [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Detaching volume 008864cd-8a1b-4c01-9e6d-019ccb215ac6
Nov 14 20:47:31 user nova-compute[76442]: INFO nova.virt.block_device [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Attempting to driver detach volume 008864cd-8a1b-4c01-9e6d-019ccb215ac6 from mountpoint /dev/vdb
Nov 14 20:47:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Attempting to detach device vdb from instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:47:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:47:31 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:47:31 user nova-compute[76442]:   <source dev="/dev/sdf"/>
Nov 14 20:47:31 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:47:31 user nova-compute[76442]:   <serial>008864cd-8a1b-4c01-9e6d-019ccb215ac6</serial>
Nov 14 20:47:31 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:47:31 user nova-compute[76442]: </disk>
Nov 14 20:47:31 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:47:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully detached device vdb from instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d from the persistent domain config.
Nov 14 20:47:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:47:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:47:31 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:47:31 user nova-compute[76442]:   <source dev="/dev/sdf"/>
Nov 14 20:47:31 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:47:31 user nova-compute[76442]:   <serial>008864cd-8a1b-4c01-9e6d-019ccb215ac6</serial>
Nov 14 20:47:31 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:47:31 user nova-compute[76442]: </disk>
Nov 14 20:47:31 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:47:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:47:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-01c14a3c-5db5-44e3-b293-074e35a2fff0 req-44dc71b5-bada-4584-a1b8-b218c373c258 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received event network-changed-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:47:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-01c14a3c-5db5-44e3-b293-074e35a2fff0 req-44dc71b5-bada-4584-a1b8-b218c373c258 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Refreshing instance network info cache due to event network-changed-4c21af8e-263d-47b2-827d-3c9c63c06ef9. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:47:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-01c14a3c-5db5-44e3-b293-074e35a2fff0 req-44dc71b5-bada-4584-a1b8-b218c373c258 service nova] Acquiring lock "refresh_cache-4fbe4b37-bb70-4858-b79e-b44bab71cc02" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:47:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-01c14a3c-5db5-44e3-b293-074e35a2fff0 req-44dc71b5-bada-4584-a1b8-b218c373c258 service nova] Acquired lock "refresh_cache-4fbe4b37-bb70-4858-b79e-b44bab71cc02" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:47:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-01c14a3c-5db5-44e3-b293-074e35a2fff0 req-44dc71b5-bada-4584-a1b8-b218c373c258 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Refreshing network info cache for port 4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:47:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-01c14a3c-5db5-44e3-b293-074e35a2fff0 req-44dc71b5-bada-4584-a1b8-b218c373c258 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Updated VIF entry in instance network info cache for port 4c21af8e-263d-47b2-827d-3c9c63c06ef9. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:47:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-01c14a3c-5db5-44e3-b293-074e35a2fff0 req-44dc71b5-bada-4584-a1b8-b218c373c258 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Updating instance_info_cache with network_info: [{"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:47:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-01c14a3c-5db5-44e3-b293-074e35a2fff0 req-44dc71b5-bada-4584-a1b8-b218c373c258 service nova] Releasing lock "refresh_cache-4fbe4b37-bb70-4858-b79e-b44bab71cc02" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:47:47 user nova-compute[76442]: INFO nova.compute.claims [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Claim successful on node user
Nov 14 20:47:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:48 user nova-compute[76442]: INFO nova.compute.manager [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Attaching volume e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 to /dev/vdb
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG os_brick.utils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[972e61fd-282c-4c33-83b5-a7cac86e4384]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8535bbd-6c97-4290-ba28-343c0bba2409]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df3418-252c-4380-bbdf-2fe370b90c78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86cfef4-f7a5-4967-906a-113dd8a16405]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:47:48 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8be0e03-7479-4d2d-8a0e-f0bee09d40c5]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG os_brick.utils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Updating existing volume attachment record: 1a25f10d-43af-475f-8e7f-9be84206bec2 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:47:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.policy [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45d53bb1eb4f416fa202ada14ba5ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc5de9e6eaa43439c6d0b2b1c1dccf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:47:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Creating image(s)
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "/opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "/opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28.part --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG nova.virt.images [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] c047c0aa-4f92-4919-901e-be40e83724bc was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28.part /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Successfully created port: 84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28.part /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28.converted" returned: 0 in 0.222s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.095s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28 --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Successfully updated port: 84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-d17efba9-678f-434e-a5ed-a8bbf49e5bda req-be5bf072-ce22-490e-8195-6bb44476c113 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-d17efba9-678f-434e-a5ed-a8bbf49e5bda req-be5bf072-ce22-490e-8195-6bb44476c113 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing instance network info cache due to event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d17efba9-678f-434e-a5ed-a8bbf49e5bda req-be5bf072-ce22-490e-8195-6bb44476c113 service nova] Acquiring lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d17efba9-678f-434e-a5ed-a8bbf49e5bda req-be5bf072-ce22-490e-8195-6bb44476c113 service nova] Acquired lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG nova.network.neutron [req-d17efba9-678f-434e-a5ed-a8bbf49e5bda req-be5bf072-ce22-490e-8195-6bb44476c113 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing network info cache for port 84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG nova.network.neutron [req-d17efba9-678f-434e-a5ed-a8bbf49e5bda req-be5bf072-ce22-490e-8195-6bb44476c113 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28 --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28,backing_fmt=raw /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28,backing_fmt=raw /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk 1073741824" returned: 0 in 0.046s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.network.neutron [req-d17efba9-678f-434e-a5ed-a8bbf49e5bda req-be5bf072-ce22-490e-8195-6bb44476c113 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d17efba9-678f-434e-a5ed-a8bbf49e5bda req-be5bf072-ce22-490e-8195-6bb44476c113 service nova] Releasing lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquired lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28 --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Cannot resize image /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Ensure instance console log exists: /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.network.neutron [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updating instance_info_cache with network_info: [{"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Releasing lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Instance network_info: |[{"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Start _get_guest_xml network_info=[{"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:47:45Z,direct_url=<?>,disk_format='qcow2',id=c047c0aa-4f92-4919-901e-be40e83724bc,min_disk=0,min_ram=0,name='tempest-scenario-img--419189770',owner='3dc5de9e6eaa43439c6d0b2b1c1dccf8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:47:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c047c0aa-4f92-4919-901e-be40e83724bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:47:50 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:47:50 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:47:45Z,direct_url=<?>,disk_format='qcow2',id=c047c0aa-4f92-4919-901e-be40e83724bc,min_disk=0,min_ram=0,name='tempest-scenario-img--419189770',owner='3dc5de9e6eaa43439c6d0b2b1c1dccf8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:47:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2130661136',display_name='tempest-TestMinimumBasicScenario-server-2130661136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2130661136',id=31,image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFF+s/3VSD44gIlOirpYAcop6pTflhvSLdYoJMOJGvy3Rft7VgQfNPniWXQv57ySyOJq+6cHi724M/oBlIkiAq6OuRhTVWk3XsPmG2VNbyAHrdtq+ubZUOeC622l9KYIA==',key_name='tempest-TestMinimumBasicScenario-229484950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dc5de9e6eaa43439c6d0b2b1c1dccf8',ramdisk_id='',reservation_id='r-3zp0ew5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1647137476',owner_user_name='tempest-TestMinimumBasicScenario-1647137476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:47:48Z,user_data=None,user_id='45d53bb1eb4f416fa202ada14ba5ca10',uuid=a4a163ab-45ce-4db5-860c-61da5fe9b734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converting VIF {"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.objects.instance [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'pci_devices' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:47:50 user nova-compute[76442]:   <uuid>a4a163ab-45ce-4db5-860c-61da5fe9b734</uuid>
Nov 14 20:47:50 user nova-compute[76442]:   <name>instance-0000001f</name>
Nov 14 20:47:50 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:47:50 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:47:50 user nova-compute[76442]:   <metadata>
Nov 14 20:47:50 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:47:50 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:47:50 user nova-compute[76442]:       <nova:name>tempest-TestMinimumBasicScenario-server-2130661136</nova:name>
Nov 14 20:47:50 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:47:50</nova:creationTime>
Nov 14 20:47:50 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:47:50 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:47:50 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:47:50 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:47:50 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:47:50 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:47:50 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:47:50 user nova-compute[76442]:       <nova:owner>
Nov 14 20:47:50 user nova-compute[76442]:         <nova:user uuid="45d53bb1eb4f416fa202ada14ba5ca10">tempest-TestMinimumBasicScenario-1647137476-project-member</nova:user>
Nov 14 20:47:50 user nova-compute[76442]:         <nova:project uuid="3dc5de9e6eaa43439c6d0b2b1c1dccf8">tempest-TestMinimumBasicScenario-1647137476</nova:project>
Nov 14 20:47:50 user nova-compute[76442]:       </nova:owner>
Nov 14 20:47:50 user nova-compute[76442]:       <nova:root type="image" uuid="c047c0aa-4f92-4919-901e-be40e83724bc"/>
Nov 14 20:47:50 user nova-compute[76442]:       <nova:ports>
Nov 14 20:47:50 user nova-compute[76442]:         <nova:port uuid="84f6b501-0b46-4c51-92da-2037bb8a1cf1">
Nov 14 20:47:50 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 20:47:50 user nova-compute[76442]:         </nova:port>
Nov 14 20:47:50 user nova-compute[76442]:       </nova:ports>
Nov 14 20:47:50 user nova-compute[76442]:     </nova:instance>
Nov 14 20:47:50 user nova-compute[76442]:   </metadata>
Nov 14 20:47:50 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:47:50 user nova-compute[76442]:     <system>
Nov 14 20:47:50 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:47:50 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:47:50 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:47:50 user nova-compute[76442]:       <entry name="serial">a4a163ab-45ce-4db5-860c-61da5fe9b734</entry>
Nov 14 20:47:50 user nova-compute[76442]:       <entry name="uuid">a4a163ab-45ce-4db5-860c-61da5fe9b734</entry>
Nov 14 20:47:50 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:47:50 user nova-compute[76442]:     </system>
Nov 14 20:47:50 user nova-compute[76442]:   </sysinfo>
Nov 14 20:47:50 user nova-compute[76442]:   <os>
Nov 14 20:47:50 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:47:50 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:47:50 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:47:50 user nova-compute[76442]:   </os>
Nov 14 20:47:50 user nova-compute[76442]:   <features>
Nov 14 20:47:50 user nova-compute[76442]:     <acpi/>
Nov 14 20:47:50 user nova-compute[76442]:     <apic/>
Nov 14 20:47:50 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:47:50 user nova-compute[76442]:   </features>
Nov 14 20:47:50 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:47:50 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:47:50 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:47:50 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:47:50 user nova-compute[76442]:   </clock>
Nov 14 20:47:50 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:47:50 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:47:50 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:47:50 user nova-compute[76442]:   </cpu>
Nov 14 20:47:50 user nova-compute[76442]:   <devices>
Nov 14 20:47:50 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:47:50 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:47:50 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk"/>
Nov 14 20:47:50 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:47:50 user nova-compute[76442]:     </disk>
Nov 14 20:47:50 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:47:50 user nova-compute[76442]:       <mac address="fa:16:3e:f7:fb:3f"/>
Nov 14 20:47:50 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:47:50 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:47:50 user nova-compute[76442]:       <target dev="tap84f6b501-0b"/>
Nov 14 20:47:50 user nova-compute[76442]:     </interface>
Nov 14 20:47:50 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:47:50 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/console.log" append="off"/>
Nov 14 20:47:50 user nova-compute[76442]:     </serial>
Nov 14 20:47:50 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:47:50 user nova-compute[76442]:     <video>
Nov 14 20:47:50 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:47:50 user nova-compute[76442]:     </video>
Nov 14 20:47:50 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:47:50 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:47:50 user nova-compute[76442]:     </rng>
Nov 14 20:47:50 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:47:50 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:47:50 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:47:50 user nova-compute[76442]:     </memballoon>
Nov 14 20:47:50 user nova-compute[76442]:   </devices>
Nov 14 20:47:50 user nova-compute[76442]: </domain>
Nov 14 20:47:50 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2130661136',display_name='tempest-TestMinimumBasicScenario-server-2130661136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2130661136',id=31,image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFF+s/3VSD44gIlOirpYAcop6pTflhvSLdYoJMOJGvy3Rft7VgQfNPniWXQv57ySyOJq+6cHi724M/oBlIkiAq6OuRhTVWk3XsPmG2VNbyAHrdtq+ubZUOeC622l9KYIA==',key_name='tempest-TestMinimumBasicScenario-229484950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dc5de9e6eaa43439c6d0b2b1c1dccf8',ramdisk_id='',reservation_id='r-3zp0ew5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1647137476',owner_user_name='tempest-TestMinimumBasicScenario-1647137476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:47:48Z,user_data=None,user_id='45d53bb1eb4f416fa202ada14ba5ca10',uuid=a4a163ab-45ce-4db5-860c-61da5fe9b734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converting VIF {"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG os_vif [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b4d302f-5d41-5c11-9b5a-f24f2c9460e8', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84f6b501-0b, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84f6b501-0b, col_values=(('qos', UUID('aacca9ba-ca29-438b-9321-cca532851177')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84f6b501-0b, col_values=(('external_ids', {'iface-id': '84f6b501-0b46-4c51-92da-2037bb8a1cf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:fb:3f', 'vm-uuid': 'a4a163ab-45ce-4db5-860c-61da5fe9b734'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:50 user nova-compute[76442]: INFO os_vif [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b')
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:47:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No VIF found with MAC fa:16:3e:f7:fb:3f, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:51 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d is timed out.
Nov 14 20:47:51 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully detached device vdb from instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d from the live domain config.
Nov 14 20:47:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DwqkYZNg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:47:51 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:47:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3dc40a-55b7-4c1e-b9e8-5e11113d943c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:47:51 user nova-compute[76442]: No targets found.
Nov 14 20:47:51 user nova-compute[76442]: iSNS:
Nov 14 20:47:51 user nova-compute[76442]: No targets found.
Nov 14 20:47:51 user nova-compute[76442]: STATIC:
Nov 14 20:47:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:47:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:47:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:47:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6
Nov 14 20:47:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:47:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:47:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:47:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:47:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:47:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752
Nov 14 20:47:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:47:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:47:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:47:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:47:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:47:51 user nova-compute[76442]: FIRMWARE:
Nov 14 20:47:51 user nova-compute[76442]: No targets found.
Nov 14 20:47:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:47:51 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:47:51 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea495a6-4bda-4560-a4ab-fb8f1d43f913]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cb772c-7d71-48d0-bfe1-7a4a607aeaec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:52 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:52 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:52 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:52 user nova-compute[76442]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 (non-flash)
Nov 14 20:47:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:52 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:52 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:52 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:52 user nova-compute[76442]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 (non-flash)
Nov 14 20:47:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e8793400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6'): ({'sdf'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Removing single pathed devices sdf {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9912c4c6-7512-4feb-9887-452a2fefcbd3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60db91-bde2-47c2-8b74-67d01e4a7ea5]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Flushing IO for device /dev/sdf {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84f189a-1a95-42d7-80cd-eb831831bcb3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-7cf74877-a1fa-4b63-a965-2ac4d9351e3f req-304a92be-18af-4869-883d-e0dea4548d28 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7cf74877-a1fa-4b63-a965-2ac4d9351e3f req-304a92be-18af-4869-883d-e0dea4548d28 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7cf74877-a1fa-4b63-a965-2ac4d9351e3f req-304a92be-18af-4869-883d-e0dea4548d28 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7cf74877-a1fa-4b63-a965-2ac4d9351e3f req-304a92be-18af-4869-883d-e0dea4548d28 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-7cf74877-a1fa-4b63-a965-2ac4d9351e3f req-304a92be-18af-4869-883d-e0dea4548d28 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:47:52 user nova-compute[76442]: WARNING nova.compute.manager [req-7cf74877-a1fa-4b63-a965-2ac4d9351e3f req-304a92be-18af-4869-883d-e0dea4548d28 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state building and task_state spawning.
Nov 14 20:47:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bfa418-ba5d-412e-adf6-ddfccfec5cf6]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7209e2f-ae20-4dfa-b5c1-50318f1ad192]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[258ff323-101e-4498-ab20-12453f6a05e3]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6, portal: 172.16.0.220,3260]
Nov 14 20:47:52 user nova-compute[76442]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6, portal: 172.16.0.220,3260] successful.
Nov 14 20:47:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008864cd-8a1b-4c01-9e6d-019ccb215ac6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdf48a8-0425-4ef9-89f5-18bd68bae510]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] <== disconnect_volume: return (412ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:53 user nova-compute[76442]: DEBUG nova.objects.instance [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'flavor' on Instance uuid 9bc953e0-e107-4b67-b32a-66e6d3142f7d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-53048f87-df00-485d-8b3c-db78ae6ce39e tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.838s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:47:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Instance spawned successfully.
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:47:54 user nova-compute[76442]: INFO nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-b7af617e-bb44-44d4-a78b-d089ccd1e816 req-ea173fe0-039e-4619-86cc-11c283e56bfb service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b7af617e-bb44-44d4-a78b-d089ccd1e816 req-ea173fe0-039e-4619-86cc-11c283e56bfb service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b7af617e-bb44-44d4-a78b-d089ccd1e816 req-ea173fe0-039e-4619-86cc-11c283e56bfb service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b7af617e-bb44-44d4-a78b-d089ccd1e816 req-ea173fe0-039e-4619-86cc-11c283e56bfb service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-b7af617e-bb44-44d4-a78b-d089ccd1e816 req-ea173fe0-039e-4619-86cc-11c283e56bfb service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:47:54 user nova-compute[76442]: WARNING nova.compute.manager [req-b7af617e-bb44-44d4-a78b-d089ccd1e816 req-ea173fe0-039e-4619-86cc-11c283e56bfb service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state building and task_state spawning.
Nov 14 20:47:54 user nova-compute[76442]: INFO nova.compute.manager [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Took 6.57 seconds to build instance.
Nov 14 20:47:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd204a52-0b7b-47b8-a07a-d7ae2c5ccb18 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.658s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flpmbDoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:47:55 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:47:55 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:47:55 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[91003b85-97b4-496b-b3b4-80d8d3d14631]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:47:55 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1633e37a-05e4-4f8c-88b6-5ba0b89f9747]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27] added
Nov 14 20:47:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fedd5ef-242f-42cf-98de-16bf556bd1c1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f76069-3667-4a8f-85f1-3d63281daad5]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flpmbDoX {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flpmbDoX" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb215af-b39c-4d67-ba14-e8b501eab0d8]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'flpmbDoX'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d177c80-4a30-46ac-b6c1-3776b460398a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8551119e-7c36-4732-977c-8dc0ddc97ef8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4815a94-ea39-4d6e-8c23-a9acdd619d40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27, portal: 172.16.0.220,3260]
Nov 14 20:47:55 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27, portal: 172.16.0.220,3260] successful.
Nov 14 20:47:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[917330bc-dd9b-43ab-959b-38f6257b2c9a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee74efa2-81ff-45a4-8325-2eb2e89ada42]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:47:55 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:47:55 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d892f8-740e-47e6-b3fb-aaa6f7efb8d5]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:55 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:47:56 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:47:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flpmbDoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:47:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:47:56 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23166333330316539', 'path': '/dev/sdf'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:47:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166333330316539', 'path': '/dev/sdf'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:47:56 user nova-compute[76442]: DEBUG nova.objects.instance [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:47:56 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:47:56 user nova-compute[76442]:   <source dev="/dev/sdf"/>
Nov 14 20:47:56 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:47:56 user nova-compute[76442]:   <serial>e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27</serial>
Nov 14 20:47:56 user nova-compute[76442]: </disk>
Nov 14 20:47:56 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:47:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:47:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:47:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No VIF found with MAC fa:16:3e:1c:0a:7d, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:47:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:47:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8311c93d-c7b0-4cef-b088-46663c9cf84c tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.114s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:47:59 user nova-compute[76442]: INFO nova.compute.manager [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Attaching volume 86904328-7874-47ec-aa3d-4e0e1905538a to /dev/vdc
Nov 14 20:47:59 user nova-compute[76442]: DEBUG os_brick.utils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[782caf74-913d-476e-9fe2-8356bd5bd16d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7516b05-9aa8-4066-988d-8adb25dd7ff9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dae4613-c733-417f-9ff1-6e6e1512392e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d347ba7-ce24-4c3e-8f2b-87aace1e3f5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:47:59 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:47:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aacfcff-37f2-409c-a086-e7d2846ca356]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG os_brick.utils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:47:59 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Updating existing volume attachment record: 5857baae-4b0b-4c4f-9e28-1fd2b939e871 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:48:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:03 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kHOpWANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:48:04 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:48:04 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:48:04 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e6023b-324d-45ad-91c9-c3db1f47d866]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:48:04 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85b6b19-0a1b-4e2e-ac71-8d75d445ebd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a] added
Nov 14 20:48:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7386d6f-75c3-4607-a263-c54e41bc032a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a702cf-0560-4d0a-a06f-3cff1fc1511c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kHOpWANr {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kHOpWANr" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd88c82-92f9-460a-8266-c2c908de3c49]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kHOpWANr'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6fc7a7-4a6e-4e2e-a2de-1ba822ce06d1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[11009e60-0b90-4078-9d1e-a7f90b5132a7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a04a2d6-4c87-4d5b-a3d6-98358873f608]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a, portal: 172.16.0.220,3260]
Nov 14 20:48:04 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a, portal: 172.16.0.220,3260] successful.
Nov 14 20:48:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3492eeff-e73a-4961-ab18-496fdf294e25]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fa7636-0fc9-4422-a844-3e4ae3a07080]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:48:04 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4e77c0-2c5f-42d8-9dbc-73e71cf56da9]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "31c7399a-07f6-40d7-a62c-8fa374193ba0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:05 user nova-compute[76442]: INFO nova.compute.manager [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Terminating instance
Nov 14 20:48:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kHOpWANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26666656635393164', 'path': '/dev/sdg'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666656635393164', 'path': '/dev/sdg'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:48:05 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:48:05 user nova-compute[76442]:   <source dev="/dev/sdg"/>
Nov 14 20:48:05 user nova-compute[76442]:   <target dev="vdc" bus="virtio"/>
Nov 14 20:48:05 user nova-compute[76442]:   <serial>86904328-7874-47ec-aa3d-4e0e1905538a</serial>
Nov 14 20:48:05 user nova-compute[76442]: </disk>
Nov 14 20:48:05 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-214c5a0b-ea4c-434b-950e-40d91d9afd88 req-6a6e0f67-0677-42fe-9659-e36d9ee1cc54 service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received event network-vif-unplugged-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-214c5a0b-ea4c-434b-950e-40d91d9afd88 req-6a6e0f67-0677-42fe-9659-e36d9ee1cc54 service nova] Acquiring lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-214c5a0b-ea4c-434b-950e-40d91d9afd88 req-6a6e0f67-0677-42fe-9659-e36d9ee1cc54 service nova] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-214c5a0b-ea4c-434b-950e-40d91d9afd88 req-6a6e0f67-0677-42fe-9659-e36d9ee1cc54 service nova] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-214c5a0b-ea4c-434b-950e-40d91d9afd88 req-6a6e0f67-0677-42fe-9659-e36d9ee1cc54 service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] No waiting events found dispatching network-vif-unplugged-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-214c5a0b-ea4c-434b-950e-40d91d9afd88 req-6a6e0f67-0677-42fe-9659-e36d9ee1cc54 service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received event network-vif-unplugged-ad6892f7-b246-4e5d-84db-bde7463fad35 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:48:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Instance destroyed successfully.
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lazy-loading 'resources' on Instance uuid 31c7399a-07f6-40d7-a62c-8fa374193ba0 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1128440010',display_name='tempest-ServersNegativeTestJSON-server-1128440010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1128440010',id=16,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d05a3b23802440898218c51c6f6eb0cf',ramdisk_id='',reservation_id='r-qqnktgnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-145042559',owner_user_name='tempest-ServersNegativeTestJSON-145042559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:39:32Z,user_data=None,user_id='26d34d0a5ada4aaf84176788da8c781c',uuid=31c7399a-07f6-40d7-a62c-8fa374193ba0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converting VIF {"id": "ad6892f7-b246-4e5d-84db-bde7463fad35", "address": "fa:16:3e:58:13:e2", "network": {"id": "6598305f-3efc-4d8c-a241-b4b29cd791f4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-115578994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d05a3b23802440898218c51c6f6eb0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad6892f7-b2", "ovs_interfaceid": "ad6892f7-b246-4e5d-84db-bde7463fad35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:13:e2,bridge_name='br-int',has_traffic_filtering=True,id=ad6892f7-b246-4e5d-84db-bde7463fad35,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6892f7-b2') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG os_vif [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:13:e2,bridge_name='br-int',has_traffic_filtering=True,id=ad6892f7-b246-4e5d-84db-bde7463fad35,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6892f7-b2') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad6892f7-b2, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dee3ba50-a5f4-4512-b2ee-1331a674e2d4) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:06 user nova-compute[76442]: INFO os_vif [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:13:e2,bridge_name='br-int',has_traffic_filtering=True,id=ad6892f7-b246-4e5d-84db-bde7463fad35,network=Network(6598305f-3efc-4d8c-a241-b4b29cd791f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad6892f7-b2')
Nov 14 20:48:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Deleting instance files /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0_del
Nov 14 20:48:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Deletion of /opt/stack/data/nova/instances/31c7399a-07f6-40d7-a62c-8fa374193ba0_del complete
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] No VIF found with MAC fa:16:3e:1c:0a:7d, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:48:06 user nova-compute[76442]: INFO nova.compute.manager [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e47f14d9-c40d-4762-bb97-ea9d3e4cb829 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.030s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-bf7dd98b-6caa-4e3b-ba06-ddb3a1856381 req-9dcdcc5e-8e76-4561-922d-517428a8cf9c service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received event network-vif-deleted-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:07 user nova-compute[76442]: INFO nova.compute.manager [req-bf7dd98b-6caa-4e3b-ba06-ddb3a1856381 req-9dcdcc5e-8e76-4561-922d-517428a8cf9c service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Neutron deleted interface ad6892f7-b246-4e5d-84db-bde7463fad35; detaching it from the instance and deleting it from the info cache
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.network.neutron [req-bf7dd98b-6caa-4e3b-ba06-ddb3a1856381 req-9dcdcc5e-8e76-4561-922d-517428a8cf9c service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:07 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Took 1.12 seconds to deallocate network for instance.
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-bf7dd98b-6caa-4e3b-ba06-ddb3a1856381 req-9dcdcc5e-8e76-4561-922d-517428a8cf9c service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Detach interface failed, port_id=ad6892f7-b246-4e5d-84db-bde7463fad35, reason: Instance 31c7399a-07f6-40d7-a62c-8fa374193ba0 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:07 user nova-compute[76442]: INFO nova.compute.manager [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Detaching volume e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:07 user nova-compute[76442]: INFO nova.virt.block_device [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Attempting to driver detach volume e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 from mountpoint /dev/vdb
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Attempting to detach device vdb from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:48:07 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:48:07 user nova-compute[76442]:   <source dev="/dev/sdf"/>
Nov 14 20:48:07 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:48:07 user nova-compute[76442]:   <serial>e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27</serial>
Nov 14 20:48:07 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:48:07 user nova-compute[76442]: </disk>
Nov 14 20:48:07 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:48:07 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully detached device vdb from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 from the persistent domain config.
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:48:07 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:48:07 user nova-compute[76442]:   <source dev="/dev/sdf"/>
Nov 14 20:48:07 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:48:07 user nova-compute[76442]:   <serial>e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27</serial>
Nov 14 20:48:07 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:48:07 user nova-compute[76442]: </disk>
Nov 14 20:48:07 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:48:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-ff8f5b2a-6cb0-4363-ae38-7dd770687788 req-4199d51f-ed8f-4a16-9180-45972d8fb641 service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received event network-vif-plugged-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ff8f5b2a-6cb0-4363-ae38-7dd770687788 req-4199d51f-ed8f-4a16-9180-45972d8fb641 service nova] Acquiring lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ff8f5b2a-6cb0-4363-ae38-7dd770687788 req-4199d51f-ed8f-4a16-9180-45972d8fb641 service nova] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ff8f5b2a-6cb0-4363-ae38-7dd770687788 req-4199d51f-ed8f-4a16-9180-45972d8fb641 service nova] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-ff8f5b2a-6cb0-4363-ae38-7dd770687788 req-4199d51f-ed8f-4a16-9180-45972d8fb641 service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] No waiting events found dispatching network-vif-plugged-ad6892f7-b246-4e5d-84db-bde7463fad35 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:08 user nova-compute[76442]: WARNING nova.compute.manager [req-ff8f5b2a-6cb0-4363-ae38-7dd770687788 req-4199d51f-ed8f-4a16-9180-45972d8fb641 service nova] [instance: 31c7399a-07f6-40d7-a62c-8fa374193ba0] Received unexpected event network-vif-plugged-ad6892f7-b246-4e5d-84db-bde7463fad35 for instance with vm_state deleted and task_state None.
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:08 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Deleted allocations for instance 31c7399a-07f6-40d7-a62c-8fa374193ba0
Nov 14 20:48:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cdeef092-ee36-4dfc-9ec4-4f2c892cf1af tempest-ServersNegativeTestJSON-145042559 tempest-ServersNegativeTestJSON-145042559-project-member] Lock "31c7399a-07f6-40d7-a62c-8fa374193ba0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.883s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:48:11 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:48:11 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7423MB free_disk=25.067157745361328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 88dd9488-e777-4b33-9702-e8f0353a62c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 447a1211-ebb6-4b4e-9207-047312e59f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2458523e-c461-4cd5-903c-2d7ab0222162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 4aaca85e-1424-4feb-af15-a7d320fe0a18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a4a163ab-45ce-4db5-860c-61da5fe9b734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:48:11 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:48:12 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:48:12 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:48:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:48:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updating instance_info_cache with network_info: [{"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:48:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:48:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:16 user nova-compute[76442]: INFO nova.compute.manager [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Rescuing
Nov 14 20:48:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:48:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquired lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:48:16 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:48:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Updating instance_info_cache with network_info: [{"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Releasing lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:48:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:19 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Instance destroyed successfully.
Nov 14 20:48:19 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Attempting a stable device rescue
Nov 14 20:48:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76442) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 20:48:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Instance directory exists: not creating {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 20:48:19 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Creating image(s)
Nov 14 20:48:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "/opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "/opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "/opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:19 user nova-compute[76442]: DEBUG nova.objects.instance [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "dfc994199dc7e57c2dd5cbb9545c4af82c00a437" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "dfc994199dc7e57c2dd5cbb9545c4af82c00a437" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-98244b2c-b1d2-4a7a-bc94-9d20eb33e1ed req-442ed52b-bdc2-4b35-939a-c3b9e661e9f7 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-98244b2c-b1d2-4a7a-bc94-9d20eb33e1ed req-442ed52b-bdc2-4b35-939a-c3b9e661e9f7 service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-98244b2c-b1d2-4a7a-bc94-9d20eb33e1ed req-442ed52b-bdc2-4b35-939a-c3b9e661e9f7 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-98244b2c-b1d2-4a7a-bc94-9d20eb33e1ed req-442ed52b-bdc2-4b35-939a-c3b9e661e9f7 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-98244b2c-b1d2-4a7a-bc94-9d20eb33e1ed req-442ed52b-bdc2-4b35-939a-c3b9e661e9f7 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:20 user nova-compute[76442]: WARNING nova.compute.manager [req-98244b2c-b1d2-4a7a-bc94-9d20eb33e1ed req-442ed52b-bdc2-4b35-939a-c3b9e661e9f7 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state active and task_state rescuing.
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437.part --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG nova.virt.images [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] 2ca52aa7-acb4-47c8-ad46-f56829c48be6 was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437.part /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:48:20 user nova-compute[76442]: INFO nova.compute.claims [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Claim successful on node user
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437.part /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437.converted" returned: 0 in 0.303s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "dfc994199dc7e57c2dd5cbb9545c4af82c00a437" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.810s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "dfc994199dc7e57c2dd5cbb9545c4af82c00a437" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "dfc994199dc7e57c2dd5cbb9545c4af82c00a437" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437 --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437,backing_fmt=raw /opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.rescue {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.755s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437,backing_fmt=raw /opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.rescue" returned: 0 in 0.054s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "dfc994199dc7e57c2dd5cbb9545c4af82c00a437" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.instance [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'migration_context' on Instance uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<4aaca85e-1424-4feb-af15-a7d320fe0a18> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Start _get_guest_xml network_info=[{"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "vif_mac": "fa:16:3e:49:46:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2ca52aa7-acb4-47c8-ad46-f56829c48be6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyNfxHRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4aaca85e-1424-4feb-af15-a7d320fe0a18', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 'serial': 'd7c5a374-7a0a-4164-b59a-f5f0a6987cf3'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '3de2559c-95c8-4bf2-91c7-4b8457383a92', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.instance [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'resources' on Instance uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<4aaca85e-1424-4feb-af15-a7d320fe0a18> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.instance [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'numa_topology' on Instance uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<4aaca85e-1424-4feb-af15-a7d320fe0a18> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:48:21 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:48:21 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:48:21 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.instance [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.policy [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d5a850b0e6c48359f78aa669b038897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69cc7950cfcf40b180d65bc96e28a2e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<4aaca85e-1424-4feb-af15-a7d320fe0a18> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyNfxHRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:48:21 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:48:21 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:48:21 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9c8c49-e68f-47d0-872a-6c6df2dd6b51]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dyNfxHRQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 20:48:21 user nova-compute[76442]: node.name = iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:48:21 user nova-compute[76442]: node.tpgt = -1
Nov 14 20:48:21 user nova-compute[76442]: node.startup = automatic
Nov 14 20:48:21 user nova-compute[76442]: node.leading_login = No
Nov 14 20:48:21 user nova-compute[76442]: iface.iscsi_ifacename = default
Nov 14 20:48:21 user nova-compute[76442]: iface.net_ifacename = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.ipaddress = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.prefix_len = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.hwaddress = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.transport_name = tcp
Nov 14 20:48:21 user nova-compute[76442]: iface.initiatorname = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.state = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.vlan_id = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.vlan_priority = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.vlan_state = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.iface_num = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.mtu = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.port = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.bootproto = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.subnet_mask = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.gateway = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.dhcp_alt_client_id = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.dhcp_dns = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.dhcp_learn_iqn = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.dhcp_vendor_id_state = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.dhcp_vendor_id = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.dhcp_slp_da = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.fragmentation = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.gratuitous_arp = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.incoming_forwarding = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.tos_state = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.tos = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.ttl = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.delayed_ack = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.tcp_nagle = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.tcp_wsf_state = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.tcp_wsf = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.tcp_timer_scale = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.tcp_timestamp = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.redirect = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.def_task_mgmt_timeout = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.header_digest = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.data_digest = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.immediate_data = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.initial_r2t = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.data_seq_inorder = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.data_pdu_inorder = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.erl = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.max_receive_data_len = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.first_burst_len = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.max_outstanding_r2t = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.max_burst_len = 0
Nov 14 20:48:21 user nova-compute[76442]: iface.chap_auth = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.bidi_chap = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.strict_login_compliance = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.discovery_auth = <empty>
Nov 14 20:48:21 user nova-compute[76442]: iface.discovery_logout = <empty>
Nov 14 20:48:21 user nova-compute[76442]: node.discovery_address = <empty>
Nov 14 20:48:21 user nova-compute[76442]: node.discovery_port = 0
Nov 14 20:48:21 user nova-compute[76442]: node.discovery_type = static
Nov 14 20:48:21 user nova-compute[76442]: node.session.initial_cmdsn = 0
Nov 14 20:48:21 user nova-compute[76442]: node.session.initial_login_retry_max = 8
Nov 14 20:48:21 user nova-compute[76442]: node.session.xmit_thread_priority = -20
Nov 14 20:48:21 user nova-compute[76442]: node.session.cmds_max = 128
Nov 14 20:48:21 user nova-compute[76442]: node.session.queue_depth = 32
Nov 14 20:48:21 user nova-compute[76442]: node.session.nr_sessions = 1
Nov 14 20:48:21 user nova-compute[76442]: node.session.auth.authmethod = CHAP
Nov 14 20:48:21 user nova-compute[76442]: node.session.auth.username = dyNfxHRQ
Nov 14 20:48:21 user nova-compute[76442]: node.session.auth.password = ***
Nov 14 20:48:21 user nova-compute[76442]: node.session.auth.username_in = <empty>
Nov 14 20:48:21 user nova-compute[76442]: node.session.auth.password_in = <empty>
Nov 14 20:48:21 user nova-compute[76442]: node.session.auth.chap_algs = MD5
Nov 14 20:48:21 user nova-compute[76442]: node.session.timeo.replacement_timeout = 120
Nov 14 20:48:21 user nova-compute[76442]: node.session.err_timeo.abort_timeout = 15
Nov 14 20:48:21 user nova-compute[76442]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 20:48:21 user nova-compute[76442]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 20:48:21 user nova-compute[76442]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.FastAbort = Yes
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.InitialR2T = No
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.ImmediateData = Yes
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.MaxConnections = 1
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 20:48:21 user nova-compute[76442]: node.session.iscsi.ERL = 0
Nov 14 20:48:21 user nova-compute[76442]: node.session.scan = manual
Nov 14 20:48:21 user nova-compute[76442]: node.session.reopen_max = 0
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].address = 172.16.0.220
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].port = 3260
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].startup = manual
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].tcp.window_size = 524288
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].tcp.type_of_service = 0
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].timeo.logout_timeout = 15
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].timeo.login_timeout = 15
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].timeo.auth_timeout = 45
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].iscsi.DataDigest = None
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].iscsi.IFMarker = No
Nov 14 20:48:21 user nova-compute[76442]: node.conn[0].iscsi.OFMarker = No
Nov 14 20:48:21 user nova-compute[76442]: # END RECORD
Nov 14 20:48:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf941254-7937-4cd4-8e79-d1ad8c14d8db]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:48:21 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Creating image(s)
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b855371f-e9e4-49d3-a8d7-24a0252678fb]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-3573357d-48ee-4b3f-b58e-aec86883bdf6 req-22dbae9e-d2a5-479d-ba05-fc13c82f29b6 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3573357d-48ee-4b3f-b58e-aec86883bdf6 req-22dbae9e-d2a5-479d-ba05-fc13c82f29b6 service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3573357d-48ee-4b3f-b58e-aec86883bdf6 req-22dbae9e-d2a5-479d-ba05-fc13c82f29b6 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3573357d-48ee-4b3f-b58e-aec86883bdf6 req-22dbae9e-d2a5-479d-ba05-fc13c82f29b6 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-3573357d-48ee-4b3f-b58e-aec86883bdf6 req-22dbae9e-d2a5-479d-ba05-fc13c82f29b6 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:21 user nova-compute[76442]: WARNING nova.compute.manager [req-3573357d-48ee-4b3f-b58e-aec86883bdf6 req-22dbae9e-d2a5-479d-ba05-fc13c82f29b6 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state active and task_state rescuing.
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyNfxHRQ {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyNfxHRQ" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff27465-676f-4b5f-969c-c92a0a1cf8c1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dyNfxHRQ'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39d0fdc-3e97-4998-ab24-2e54c4d1025d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb186f-a214-46df-bc66-ffde1c3e4d48]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:48:21 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.208s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] HCTL ('34', '0', '0', 0) found on session 33 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd700fdc-b1ea-47e4-b0b3-263bc0babd50]: (4, ('0 0 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Searching for a device in session 33 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyNfxHRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.239s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] <== connect_volume: return (241ms) {'type': 'block', 'scsi_wwn': '23539333966373661', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539333966373661', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1978269637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1978269637',id=30,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-jqc0ymvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:46:43Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=4aaca85e-1424-4feb-af15-a7d320fe0a18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "vif_mac": "fa:16:3e:49:46:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "vif_mac": "fa:16:3e:49:46:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:46:73,bridge_name='br-int',has_traffic_filtering=True,id=ea6754df-28fe-4491-aaa4-a9c27388944a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6754df-28') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.instance [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'pci_devices' on Instance uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.objects.base [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Object Instance<4aaca85e-1424-4feb-af15-a7d320fe0a18> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:48:21 user nova-compute[76442]:   <uuid>4aaca85e-1424-4feb-af15-a7d320fe0a18</uuid>
Nov 14 20:48:21 user nova-compute[76442]:   <name>instance-0000001e</name>
Nov 14 20:48:21 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:48:21 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:48:21 user nova-compute[76442]:   <metadata>
Nov 14 20:48:21 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:48:21 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:48:21 user nova-compute[76442]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1978269637</nova:name>
Nov 14 20:48:21 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:48:21</nova:creationTime>
Nov 14 20:48:21 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:48:21 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:48:21 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:48:21 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:48:21 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:48:21 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:48:21 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:48:21 user nova-compute[76442]:       <nova:owner>
Nov 14 20:48:21 user nova-compute[76442]:         <nova:user uuid="4163211b006c4fbbbdc575c0e6d02ac8">tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member</nova:user>
Nov 14 20:48:21 user nova-compute[76442]:         <nova:project uuid="f83568ed733848d09643843927ca0c42">tempest-ServerBootFromVolumeStableRescueTest-1547619353</nova:project>
Nov 14 20:48:21 user nova-compute[76442]:       </nova:owner>
Nov 14 20:48:21 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:48:21 user nova-compute[76442]:       <nova:ports>
Nov 14 20:48:21 user nova-compute[76442]:         <nova:port uuid="ea6754df-28fe-4491-aaa4-a9c27388944a">
Nov 14 20:48:21 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:48:21 user nova-compute[76442]:         </nova:port>
Nov 14 20:48:21 user nova-compute[76442]:       </nova:ports>
Nov 14 20:48:21 user nova-compute[76442]:     </nova:instance>
Nov 14 20:48:21 user nova-compute[76442]:   </metadata>
Nov 14 20:48:21 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:48:21 user nova-compute[76442]:     <system>
Nov 14 20:48:21 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:48:21 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:48:21 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:48:21 user nova-compute[76442]:       <entry name="serial">4aaca85e-1424-4feb-af15-a7d320fe0a18</entry>
Nov 14 20:48:21 user nova-compute[76442]:       <entry name="uuid">4aaca85e-1424-4feb-af15-a7d320fe0a18</entry>
Nov 14 20:48:21 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:48:21 user nova-compute[76442]:     </system>
Nov 14 20:48:21 user nova-compute[76442]:   </sysinfo>
Nov 14 20:48:21 user nova-compute[76442]:   <os>
Nov 14 20:48:21 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:48:21 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:48:21 user nova-compute[76442]:   </os>
Nov 14 20:48:21 user nova-compute[76442]:   <features>
Nov 14 20:48:21 user nova-compute[76442]:     <acpi/>
Nov 14 20:48:21 user nova-compute[76442]:     <apic/>
Nov 14 20:48:21 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:48:21 user nova-compute[76442]:   </features>
Nov 14 20:48:21 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:48:21 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:48:21 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:48:21 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:48:21 user nova-compute[76442]:   </clock>
Nov 14 20:48:21 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:48:21 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:48:21 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:48:21 user nova-compute[76442]:   </cpu>
Nov 14 20:48:21 user nova-compute[76442]:   <devices>
Nov 14 20:48:21 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:48:21 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:48:21 user nova-compute[76442]:       <source dev="/dev/sdc"/>
Nov 14 20:48:21 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:48:21 user nova-compute[76442]:       <serial>d7c5a374-7a0a-4164-b59a-f5f0a6987cf3</serial>
Nov 14 20:48:21 user nova-compute[76442]:     </disk>
Nov 14 20:48:21 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:48:21 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:48:21 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.rescue"/>
Nov 14 20:48:21 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:48:21 user nova-compute[76442]:       <boot order="1"/>
Nov 14 20:48:21 user nova-compute[76442]:     </disk>
Nov 14 20:48:21 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:48:21 user nova-compute[76442]:       <mac address="fa:16:3e:49:46:73"/>
Nov 14 20:48:21 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:48:21 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:48:21 user nova-compute[76442]:       <target dev="tapea6754df-28"/>
Nov 14 20:48:21 user nova-compute[76442]:     </interface>
Nov 14 20:48:21 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:48:21 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/console.log" append="off"/>
Nov 14 20:48:21 user nova-compute[76442]:     </serial>
Nov 14 20:48:21 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:48:21 user nova-compute[76442]:     <video>
Nov 14 20:48:21 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:48:21 user nova-compute[76442]:     </video>
Nov 14 20:48:21 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:48:21 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:48:21 user nova-compute[76442]:     </rng>
Nov 14 20:48:21 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:48:21 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:48:21 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:48:21 user nova-compute[76442]:     </memballoon>
Nov 14 20:48:21 user nova-compute[76442]:   </devices>
Nov 14 20:48:21 user nova-compute[76442]: </domain>
Nov 14 20:48:21 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:48:21 user nova-compute[76442]: INFO nova.compute.manager [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Terminating instance
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:48:21 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Instance destroyed successfully.
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] No VIF found with MAC fa:16:3e:49:46:73, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk 1073741824" returned: 0 in 0.060s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.201s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG nova.network.neutron [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Successfully created port: ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Cannot resize image /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Ensure instance console log exists: /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG nova.network.neutron [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Successfully updated port: ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquired lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG nova.network.neutron [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG nova.network.neutron [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:48:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Instance destroyed successfully.
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.objects.instance [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lazy-loading 'resources' on Instance uuid 9bc953e0-e107-4b67-b32a-66e6d3142f7d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.neutron [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updating instance_info_cache with network_info: [{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:45:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-800928174',display_name='tempest-AttachVolumeNegativeTest-server-800928174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-800928174',id=28,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcHzfeJOVxv4J47BK6c9Eoe45GTkdsDKTr9Zdfa/PcBNEVaOK1SaXA+iNb56znc+om1oGcxlBo5RN/90zCBHsrtzl84LBZBjpr1F/8H5HUBa9qykU6IMvj3D9YU4XekrQ==',key_name='tempest-keypair-1193905275',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bd9ff5bbf1a49cca0d72a3ab4b34432',ramdisk_id='',reservation_id='r-qkmfzbzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1957433764',owner_user_name='tempest-AttachVolumeNegativeTest-1957433764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05ec208e91594c36a30683258c9c687d',uuid=9bc953e0-e107-4b67-b32a-66e6d3142f7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converting VIF {"id": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "address": "fa:16:3e:b4:02:2e", "network": {"id": "5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1213760003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bd9ff5bbf1a49cca0d72a3ab4b34432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c09ca-d2", "ovs_interfaceid": "090c09ca-d26a-46e1-a42c-e31638cf31a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:02:2e,bridge_name='br-int',has_traffic_filtering=True,id=090c09ca-d26a-46e1-a42c-e31638cf31a1,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c09ca-d2') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG os_vif [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:02:2e,bridge_name='br-int',has_traffic_filtering=True,id=090c09ca-d26a-46e1-a42c-e31638cf31a1,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c09ca-d2') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap090c09ca-d2, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3988fb0b-5790-4eeb-933d-a12efce5436d) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Releasing lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Instance network_info: |[{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Start _get_guest_xml network_info=[{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:48:23 user nova-compute[76442]: INFO os_vif [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:02:2e,bridge_name='br-int',has_traffic_filtering=True,id=090c09ca-d26a-46e1-a42c-e31638cf31a1,network=Network(5df2bf7a-38f9-43ea-ba16-bfacc8b7de1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c09ca-d2')
Nov 14 20:48:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Deleting instance files /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d_del
Nov 14 20:48:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Deletion of /opt/stack/data/nova/instances/9bc953e0-e107-4b67-b32a-66e6d3142f7d_del complete
Nov 14 20:48:23 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:48:23 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1940446192',display_name='tempest-ServerRescueNegativeTestJSON-server-1940446192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1940446192',id=32,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgnXgFu74relfHlulTvLq9270uICYyFfK/4kFO7eURj/wtc1sNY6gK2CDVnpxY7VAiTVGE+O8mDzv3nEpSbG0x4Zmzimj0ejtyt0mW2iNwN6eAq6WVzhQJ3T53Qi32cLQ==',key_name='tempest-keypair-1017385623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-x9vrzi8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d5a850b0e6c48359f78aa669b038897',uuid=16cd640b-de2b-488c-82d6-05c49cf526ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:fe:40,bridge_name='br-int',has_traffic_filtering=True,id=ea269041-ffaf-4db5-93cf-170276a43527,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea269041-ff') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.objects.instance [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'pci_devices' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:23 user nova-compute[76442]: INFO nova.compute.manager [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 14 20:48:23 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:48:23 user nova-compute[76442]:   <uuid>16cd640b-de2b-488c-82d6-05c49cf526ef</uuid>
Nov 14 20:48:23 user nova-compute[76442]:   <name>instance-00000020</name>
Nov 14 20:48:23 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:48:23 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:48:23 user nova-compute[76442]:   <metadata>
Nov 14 20:48:23 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:48:23 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:48:23 user nova-compute[76442]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1940446192</nova:name>
Nov 14 20:48:23 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:48:23</nova:creationTime>
Nov 14 20:48:23 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:48:23 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:48:23 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:48:23 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:48:23 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:48:23 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:48:23 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:48:23 user nova-compute[76442]:       <nova:owner>
Nov 14 20:48:23 user nova-compute[76442]:         <nova:user uuid="5d5a850b0e6c48359f78aa669b038897">tempest-ServerRescueNegativeTestJSON-916964129-project-member</nova:user>
Nov 14 20:48:23 user nova-compute[76442]:         <nova:project uuid="69cc7950cfcf40b180d65bc96e28a2e3">tempest-ServerRescueNegativeTestJSON-916964129</nova:project>
Nov 14 20:48:23 user nova-compute[76442]:       </nova:owner>
Nov 14 20:48:23 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:48:23 user nova-compute[76442]:       <nova:ports>
Nov 14 20:48:23 user nova-compute[76442]:         <nova:port uuid="ea269041-ffaf-4db5-93cf-170276a43527">
Nov 14 20:48:23 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:48:23 user nova-compute[76442]:         </nova:port>
Nov 14 20:48:23 user nova-compute[76442]:       </nova:ports>
Nov 14 20:48:23 user nova-compute[76442]:     </nova:instance>
Nov 14 20:48:23 user nova-compute[76442]:   </metadata>
Nov 14 20:48:23 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:48:23 user nova-compute[76442]:     <system>
Nov 14 20:48:23 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:48:23 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:48:23 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:48:23 user nova-compute[76442]:       <entry name="serial">16cd640b-de2b-488c-82d6-05c49cf526ef</entry>
Nov 14 20:48:23 user nova-compute[76442]:       <entry name="uuid">16cd640b-de2b-488c-82d6-05c49cf526ef</entry>
Nov 14 20:48:23 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:48:23 user nova-compute[76442]:     </system>
Nov 14 20:48:23 user nova-compute[76442]:   </sysinfo>
Nov 14 20:48:23 user nova-compute[76442]:   <os>
Nov 14 20:48:23 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:48:23 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:48:23 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:48:23 user nova-compute[76442]:   </os>
Nov 14 20:48:23 user nova-compute[76442]:   <features>
Nov 14 20:48:23 user nova-compute[76442]:     <acpi/>
Nov 14 20:48:23 user nova-compute[76442]:     <apic/>
Nov 14 20:48:23 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:48:23 user nova-compute[76442]:   </features>
Nov 14 20:48:23 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:48:23 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:48:23 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:48:23 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:48:23 user nova-compute[76442]:   </clock>
Nov 14 20:48:23 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:48:23 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:48:23 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:48:23 user nova-compute[76442]:   </cpu>
Nov 14 20:48:23 user nova-compute[76442]:   <devices>
Nov 14 20:48:23 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:48:23 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:48:23 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk"/>
Nov 14 20:48:23 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:48:23 user nova-compute[76442]:     </disk>
Nov 14 20:48:23 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:48:23 user nova-compute[76442]:       <mac address="fa:16:3e:97:fe:40"/>
Nov 14 20:48:23 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:48:23 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:48:23 user nova-compute[76442]:       <target dev="tapea269041-ff"/>
Nov 14 20:48:23 user nova-compute[76442]:     </interface>
Nov 14 20:48:23 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:48:23 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/console.log" append="off"/>
Nov 14 20:48:23 user nova-compute[76442]:     </serial>
Nov 14 20:48:23 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:48:23 user nova-compute[76442]:     <video>
Nov 14 20:48:23 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:48:23 user nova-compute[76442]:     </video>
Nov 14 20:48:23 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:48:23 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:48:23 user nova-compute[76442]:     </rng>
Nov 14 20:48:23 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:48:23 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:48:23 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:48:23 user nova-compute[76442]:     </memballoon>
Nov 14 20:48:23 user nova-compute[76442]:   </devices>
Nov 14 20:48:23 user nova-compute[76442]: </domain>
Nov 14 20:48:23 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1940446192',display_name='tempest-ServerRescueNegativeTestJSON-server-1940446192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1940446192',id=32,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgnXgFu74relfHlulTvLq9270uICYyFfK/4kFO7eURj/wtc1sNY6gK2CDVnpxY7VAiTVGE+O8mDzv3nEpSbG0x4Zmzimj0ejtyt0mW2iNwN6eAq6WVzhQJ3T53Qi32cLQ==',key_name='tempest-keypair-1017385623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-x9vrzi8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d5a850b0e6c48359f78aa669b038897',uuid=16cd640b-de2b-488c-82d6-05c49cf526ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:fe:40,bridge_name='br-int',has_traffic_filtering=True,id=ea269041-ffaf-4db5-93cf-170276a43527,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea269041-ff') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG os_vif [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:fe:40,bridge_name='br-int',has_traffic_filtering=True,id=ea269041-ffaf-4db5-93cf-170276a43527,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea269041-ff') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '170bcec7-e521-5c20-be96-0b8707e7f93c', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea269041-ff, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea269041-ff, col_values=(('qos', UUID('e5c4961f-5781-4e0a-ac11-4a260971cc09')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea269041-ff, col_values=(('external_ids', {'iface-id': 'ea269041-ffaf-4db5-93cf-170276a43527', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:fe:40', 'vm-uuid': '16cd640b-de2b-488c-82d6-05c49cf526ef'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: INFO os_vif [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:fe:40,bridge_name='br-int',has_traffic_filtering=True,id=ea269041-ffaf-4db5-93cf-170276a43527,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea269041-ff')
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No VIF found with MAC fa:16:3e:97:fe:40, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-7f0406a7-3f0b-4794-94b8-959a9677181d req-33736faf-3e62-46ad-9fd6-fc427ea7252e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-changed-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-7f0406a7-3f0b-4794-94b8-959a9677181d req-33736faf-3e62-46ad-9fd6-fc427ea7252e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Refreshing instance network info cache due to event network-changed-ea269041-ffaf-4db5-93cf-170276a43527. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7f0406a7-3f0b-4794-94b8-959a9677181d req-33736faf-3e62-46ad-9fd6-fc427ea7252e service nova] Acquiring lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7f0406a7-3f0b-4794-94b8-959a9677181d req-33736faf-3e62-46ad-9fd6-fc427ea7252e service nova] Acquired lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.neutron [req-7f0406a7-3f0b-4794-94b8-959a9677181d req-33736faf-3e62-46ad-9fd6-fc427ea7252e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Refreshing network info cache for port ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.neutron [req-7f0406a7-3f0b-4794-94b8-959a9677181d req-33736faf-3e62-46ad-9fd6-fc427ea7252e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updated VIF entry in instance network info cache for port ea269041-ffaf-4db5-93cf-170276a43527. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG nova.network.neutron [req-7f0406a7-3f0b-4794-94b8-959a9677181d req-33736faf-3e62-46ad-9fd6-fc427ea7252e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updating instance_info_cache with network_info: [{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7f0406a7-3f0b-4794-94b8-959a9677181d req-33736faf-3e62-46ad-9fd6-fc427ea7252e service nova] Releasing lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-66d485b4-a8ed-4c68-99ea-7c0a924ef800 req-d03ca53c-f1cf-4418-aa4f-456813270bea service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received event network-vif-unplugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-66d485b4-a8ed-4c68-99ea-7c0a924ef800 req-d03ca53c-f1cf-4418-aa4f-456813270bea service nova] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-66d485b4-a8ed-4c68-99ea-7c0a924ef800 req-d03ca53c-f1cf-4418-aa4f-456813270bea service nova] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-66d485b4-a8ed-4c68-99ea-7c0a924ef800 req-d03ca53c-f1cf-4418-aa4f-456813270bea service nova] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-66d485b4-a8ed-4c68-99ea-7c0a924ef800 req-d03ca53c-f1cf-4418-aa4f-456813270bea service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] No waiting events found dispatching network-vif-unplugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-66d485b4-a8ed-4c68-99ea-7c0a924ef800 req-d03ca53c-f1cf-4418-aa4f-456813270bea service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received event network-vif-unplugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:48:24 user nova-compute[76442]: INFO nova.compute.claims [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Claim successful on node user
Nov 14 20:48:24 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:24 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Took 1.66 seconds to deallocate network for instance.
Nov 14 20:48:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.747s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.468s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.network.neutron [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:25 user nova-compute[76442]: WARNING nova.compute.manager [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state active and task_state rescuing.
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:25 user nova-compute[76442]: WARNING nova.compute.manager [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state active and task_state rescuing.
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-a08208e3-599e-4edf-9cf1-c27c1a3307d4 req-7336b5bd-2b2c-49aa-b82d-51c79c70fd9f service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received event network-vif-deleted-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:25 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.policy [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e32d699395a4756a1dc55d1450f0756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d797c60374a422eadb9e36efbe39c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:48:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:48:25 user nova-compute[76442]: INFO nova.virt.block_device [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Booting with volume aa18e9e6-8738-4939-a17e-b8f14cee1c88 at /dev/vda
Nov 14 20:48:26 user nova-compute[76442]: DEBUG os_brick.utils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80bd815-d506-4158-ae86-0c5155d687c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9016aeca-c077-4057-8517-83c224ddb644]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa6136-d305-4149-b0de-004e05d95094]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5d109c-22fc-4279-bc6e-6afeb399477d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:48:26 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3526f6b2-0b9b-4daf-895d-07b9c2398fa8]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG os_brick.utils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating existing volume attachment record: cceb499f-a0b0-4df0-a210-9128af7d9a85 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.758s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:26 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Deleted allocations for instance 9bc953e0-e107-4b67-b32a-66e6d3142f7d
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0e8d205-c386-489e-87b2-2e88adc7d477 tempest-AttachVolumeNegativeTest-1957433764 tempest-AttachVolumeNegativeTest-1957433764-project-member] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.745s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received event network-vif-plugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] Acquiring lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] Lock "9bc953e0-e107-4b67-b32a-66e6d3142f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] No waiting events found dispatching network-vif-plugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:26 user nova-compute[76442]: WARNING nova.compute.manager [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] [instance: 9bc953e0-e107-4b67-b32a-66e6d3142f7d] Received unexpected event network-vif-plugged-090c09ca-d26a-46e1-a42c-e31638cf31a1 for instance with vm_state deleted and task_state None.
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:26 user nova-compute[76442]: WARNING nova.compute.manager [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state building and task_state spawning.
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:26 user nova-compute[76442]: WARNING nova.compute.manager [req-332ded7a-f757-4600-8b93-bd15c1904349 req-397e48f5-5fbd-472a-b86a-0d02e24e2049 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state building and task_state spawning.
Nov 14 20:48:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Successfully created port: 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Successfully updated port: 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquired lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bf564310-26d3-489a-ba65-4363018efd8d tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating instance_info_cache with network_info: [{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Releasing lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance network_info: |[{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-9e60022e-ecc3-481a-a3f5-66f357234f5d req-b71c7082-dd2a-4f90-8290-5af6540cf9da service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-9e60022e-ecc3-481a-a3f5-66f357234f5d req-b71c7082-dd2a-4f90-8290-5af6540cf9da service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing instance network info cache due to event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9e60022e-ecc3-481a-a3f5-66f357234f5d req-b71c7082-dd2a-4f90-8290-5af6540cf9da service nova] Acquiring lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9e60022e-ecc3-481a-a3f5-66f357234f5d req-b71c7082-dd2a-4f90-8290-5af6540cf9da service nova] Acquired lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.network.neutron [req-9e60022e-ecc3-481a-a3f5-66f357234f5d req-b71c7082-dd2a-4f90-8290-5af6540cf9da service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:48:27 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Instance spawned successfully.
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:27 user nova-compute[76442]: INFO nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 14 20:48:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:48:27 user nova-compute[76442]: INFO nova.compute.manager [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Took 7.65 seconds to build instance.
Nov 14 20:48:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-48fae03a-c6f5-485e-ac7d-c146efdf13ec tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.755s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-9e60022e-ecc3-481a-a3f5-66f357234f5d req-b71c7082-dd2a-4f90-8290-5af6540cf9da service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updated VIF entry in instance network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-9e60022e-ecc3-481a-a3f5-66f357234f5d req-b71c7082-dd2a-4f90-8290-5af6540cf9da service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating instance_info_cache with network_info: [{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9e60022e-ecc3-481a-a3f5-66f357234f5d req-b71c7082-dd2a-4f90-8290-5af6540cf9da service nova] Releasing lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:28 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 is timed out.
Nov 14 20:48:28 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully detached device vdb from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 from the live domain config.
Nov 14 20:48:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flpmbDoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:48:28 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab2f37-b7f5-46b6-b011-7c7b45361af1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:48:28 user nova-compute[76442]: No targets found.
Nov 14 20:48:28 user nova-compute[76442]: iSNS:
Nov 14 20:48:28 user nova-compute[76442]: No targets found.
Nov 14 20:48:28 user nova-compute[76442]: STATIC:
Nov 14 20:48:28 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:48:28 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:28 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:28 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:48:28 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:28 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:28 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752
Nov 14 20:48:28 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:28 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:28 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:48:28 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:28 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:28 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a
Nov 14 20:48:28 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:28 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:28 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27
Nov 14 20:48:28 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:28 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:28 user nova-compute[76442]: FIRMWARE:
Nov 14 20:48:28 user nova-compute[76442]: No targets found.
Nov 14 20:48:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:48:28 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:48:28 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[638eb181-fb85-4ad6-8e2a-7fd7b1abefe4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ba1df-6b4a-4917-915f-dfbb58fa5332]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 (non-flash)
Nov 14 20:48:28 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4e6feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27'): ({'sdf'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Removing single pathed devices sdf {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6196d7-824a-4736-ab6b-8048407513e3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[31746a64-10cd-44e8-a090-be28760de752]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flushing IO for device /dev/sdf {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[11368505-d383-4fae-b7e3-459c86a5979f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a52ccb-1352-4c4d-a5da-5b0f9cd27070]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1029e4-e7e3-43e0-813c-250e0dea43ab]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc2b9b0-b838-4abb-b29b-62f82c7ab4d3]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27, portal: 172.16.0.220,3260]
Nov 14 20:48:28 user nova-compute[76442]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27, portal: 172.16.0.220,3260] successful.
Nov 14 20:48:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b32d26-ae0b-4fd2-93ba-6a647dfa9c27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[089c8b1e-207b-490e-9b2f-e86378585a50]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== disconnect_volume: return (361ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:48:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:48:29 user nova-compute[76442]: DEBUG nova.objects.instance [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3fb71075-2384-4245-a12c-a3450c4db104 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.909s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:30 user nova-compute[76442]: INFO nova.compute.manager [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Detaching volume 86904328-7874-47ec-aa3d-4e0e1905538a
Nov 14 20:48:30 user nova-compute[76442]: INFO nova.virt.block_device [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Attempting to driver detach volume 86904328-7874-47ec-aa3d-4e0e1905538a from mountpoint /dev/vdc
Nov 14 20:48:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Attempting to detach device vdc from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:48:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:48:30 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:48:30 user nova-compute[76442]:   <source dev="/dev/sdg"/>
Nov 14 20:48:30 user nova-compute[76442]:   <target dev="vdc" bus="virtio"/>
Nov 14 20:48:30 user nova-compute[76442]:   <serial>86904328-7874-47ec-aa3d-4e0e1905538a</serial>
Nov 14 20:48:30 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 20:48:30 user nova-compute[76442]: </disk>
Nov 14 20:48:30 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:48:30 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully detached device vdc from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 from the persistent domain config.
Nov 14 20:48:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:48:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:48:30 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:48:30 user nova-compute[76442]:   <source dev="/dev/sdg"/>
Nov 14 20:48:30 user nova-compute[76442]:   <target dev="vdc" bus="virtio"/>
Nov 14 20:48:30 user nova-compute[76442]:   <serial>86904328-7874-47ec-aa3d-4e0e1905538a</serial>
Nov 14 20:48:30 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 20:48:30 user nova-compute[76442]: </disk>
Nov 14 20:48:30 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:48:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Creating image(s)
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Ensure instance console log exists: /opt/stack/data/nova/instances/90fb24a5-e12e-4192-b12a-17b95d6f5250/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Start _get_guest_xml network_info=[{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkqjRMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90fb24a5-e12e-4192-b12a-17b95d6f5250', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'serial': 'aa18e9e6-8738-4939-a17e-b8f14cee1c88'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'cceb499f-a0b0-4df0-a210-9128af7d9a85', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:48:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:48:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkqjRMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:48:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:48:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:48:31 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aa8601-5098-4754-8c64-8030520c5e6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:48:31 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddefdd6-17a8-45b3-9e1e-13b09f58ef9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88] added
Nov 14 20:48:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dfeffe-97f6-4d39-a2f6-794c979ad07e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[240df947-c3ad-40ef-b301-7c31f6d05fc6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkqjRMID {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkqjRMID" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8160df2e-b55b-4af5-8eed-a8ad30e3371d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SkqjRMID'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbd5097-c3eb-4f8a-b57e-d02f8cf758ff]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e14e9f-8e51-4f06-98a7-bb8441e00947]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[84484d6f-3fa2-4b1d-bc07-3887e4145926]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260]
Nov 14 20:48:31 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260] successful.
Nov 14 20:48:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61d7660-c4a3-4304-ba10-b6869dd72f5d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c244893e-92f5-42ec-9a73-56c490f60514]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:31 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:48:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb853e5-2fbb-4e21-bba3-b294b0674496]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkqjRMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23136656430303335', 'path': '/dev/sdf'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136656430303335', 'path': '/dev/sdf'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397663843',display_name='tempest-TestShelveInstance-server-1397663843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397663843',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx67k1DDPkBdKiI3IbJAC1rHUUU1hvj9H2/3jxRrPH3KPX8Zazo8oOw6NCL9quWEjhLhomjnfyfczp4TnImA5DB7QwzhGoc55zWkGQo86KPclAZssCuejQOGlibcoHz6A==',key_name='tempest-TestShelveInstance-1392324859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d797c60374a422eadb9e36efbe39c69',ramdisk_id='',reservation_id='r-8m12x60y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-371963907',owner_user_name='tempest-TestShelveInstance-371963907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:48:26Z,user_data=None,user_id='5e32d699395a4756a1dc55d1450f0756',uuid=90fb24a5-e12e-4192-b12a-17b95d6f5250,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converting VIF {"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.objects.instance [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lazy-loading 'pci_devices' on Instance uuid 90fb24a5-e12e-4192-b12a-17b95d6f5250 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:48:32 user nova-compute[76442]:   <uuid>90fb24a5-e12e-4192-b12a-17b95d6f5250</uuid>
Nov 14 20:48:32 user nova-compute[76442]:   <name>instance-00000021</name>
Nov 14 20:48:32 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:48:32 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:48:32 user nova-compute[76442]:   <metadata>
Nov 14 20:48:32 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:48:32 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:48:32 user nova-compute[76442]:       <nova:name>tempest-TestShelveInstance-server-1397663843</nova:name>
Nov 14 20:48:32 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:48:31</nova:creationTime>
Nov 14 20:48:32 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:48:32 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:48:32 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:48:32 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:48:32 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:48:32 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:48:32 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:48:32 user nova-compute[76442]:       <nova:owner>
Nov 14 20:48:32 user nova-compute[76442]:         <nova:user uuid="5e32d699395a4756a1dc55d1450f0756">tempest-TestShelveInstance-371963907-project-member</nova:user>
Nov 14 20:48:32 user nova-compute[76442]:         <nova:project uuid="5d797c60374a422eadb9e36efbe39c69">tempest-TestShelveInstance-371963907</nova:project>
Nov 14 20:48:32 user nova-compute[76442]:       </nova:owner>
Nov 14 20:48:32 user nova-compute[76442]:       <nova:ports>
Nov 14 20:48:32 user nova-compute[76442]:         <nova:port uuid="7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad">
Nov 14 20:48:32 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 20:48:32 user nova-compute[76442]:         </nova:port>
Nov 14 20:48:32 user nova-compute[76442]:       </nova:ports>
Nov 14 20:48:32 user nova-compute[76442]:     </nova:instance>
Nov 14 20:48:32 user nova-compute[76442]:   </metadata>
Nov 14 20:48:32 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:48:32 user nova-compute[76442]:     <system>
Nov 14 20:48:32 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:48:32 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:48:32 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:48:32 user nova-compute[76442]:       <entry name="serial">90fb24a5-e12e-4192-b12a-17b95d6f5250</entry>
Nov 14 20:48:32 user nova-compute[76442]:       <entry name="uuid">90fb24a5-e12e-4192-b12a-17b95d6f5250</entry>
Nov 14 20:48:32 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:48:32 user nova-compute[76442]:     </system>
Nov 14 20:48:32 user nova-compute[76442]:   </sysinfo>
Nov 14 20:48:32 user nova-compute[76442]:   <os>
Nov 14 20:48:32 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:48:32 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:48:32 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:48:32 user nova-compute[76442]:   </os>
Nov 14 20:48:32 user nova-compute[76442]:   <features>
Nov 14 20:48:32 user nova-compute[76442]:     <acpi/>
Nov 14 20:48:32 user nova-compute[76442]:     <apic/>
Nov 14 20:48:32 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:48:32 user nova-compute[76442]:   </features>
Nov 14 20:48:32 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:48:32 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:48:32 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:48:32 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:48:32 user nova-compute[76442]:   </clock>
Nov 14 20:48:32 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:48:32 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:48:32 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:48:32 user nova-compute[76442]:   </cpu>
Nov 14 20:48:32 user nova-compute[76442]:   <devices>
Nov 14 20:48:32 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:48:32 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:48:32 user nova-compute[76442]:       <source dev="/dev/sdf"/>
Nov 14 20:48:32 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:48:32 user nova-compute[76442]:       <serial>aa18e9e6-8738-4939-a17e-b8f14cee1c88</serial>
Nov 14 20:48:32 user nova-compute[76442]:     </disk>
Nov 14 20:48:32 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:48:32 user nova-compute[76442]:       <mac address="fa:16:3e:bb:8b:5f"/>
Nov 14 20:48:32 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:48:32 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:48:32 user nova-compute[76442]:       <target dev="tap7b6a2b7a-dd"/>
Nov 14 20:48:32 user nova-compute[76442]:     </interface>
Nov 14 20:48:32 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:48:32 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/90fb24a5-e12e-4192-b12a-17b95d6f5250/console.log" append="off"/>
Nov 14 20:48:32 user nova-compute[76442]:     </serial>
Nov 14 20:48:32 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:48:32 user nova-compute[76442]:     <video>
Nov 14 20:48:32 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:48:32 user nova-compute[76442]:     </video>
Nov 14 20:48:32 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:48:32 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:48:32 user nova-compute[76442]:     </rng>
Nov 14 20:48:32 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:48:32 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:48:32 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:48:32 user nova-compute[76442]:     </memballoon>
Nov 14 20:48:32 user nova-compute[76442]:   </devices>
Nov 14 20:48:32 user nova-compute[76442]: </domain>
Nov 14 20:48:32 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397663843',display_name='tempest-TestShelveInstance-server-1397663843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397663843',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx67k1DDPkBdKiI3IbJAC1rHUUU1hvj9H2/3jxRrPH3KPX8Zazo8oOw6NCL9quWEjhLhomjnfyfczp4TnImA5DB7QwzhGoc55zWkGQo86KPclAZssCuejQOGlibcoHz6A==',key_name='tempest-TestShelveInstance-1392324859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d797c60374a422eadb9e36efbe39c69',ramdisk_id='',reservation_id='r-8m12x60y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-371963907',owner_user_name='tempest-TestShelveInstance-371963907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:48:26Z,user_data=None,user_id='5e32d699395a4756a1dc55d1450f0756',uuid=90fb24a5-e12e-4192-b12a-17b95d6f5250,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converting VIF {"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG os_vif [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '135f2a60-5ef1-5443-82a5-ec4ebb0c32ce', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b6a2b7a-dd, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b6a2b7a-dd, col_values=(('qos', UUID('1d622286-110a-4b75-8cb6-0c763e383994')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b6a2b7a-dd, col_values=(('external_ids', {'iface-id': '7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:8b:5f', 'vm-uuid': '90fb24a5-e12e-4192-b12a-17b95d6f5250'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:32 user nova-compute[76442]: INFO os_vif [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd')
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:48:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] No VIF found with MAC fa:16:3e:bb:8b:5f, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:48:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-c8917b57-d774-4851-a072-998c187ae858 req-035bd8ea-753f-4544-aff3-d0e7170a1de1 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c8917b57-d774-4851-a072-998c187ae858 req-035bd8ea-753f-4544-aff3-d0e7170a1de1 service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c8917b57-d774-4851-a072-998c187ae858 req-035bd8ea-753f-4544-aff3-d0e7170a1de1 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c8917b57-d774-4851-a072-998c187ae858 req-035bd8ea-753f-4544-aff3-d0e7170a1de1 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-c8917b57-d774-4851-a072-998c187ae858 req-035bd8ea-753f-4544-aff3-d0e7170a1de1 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:34 user nova-compute[76442]: WARNING nova.compute.manager [req-c8917b57-d774-4851-a072-998c187ae858 req-035bd8ea-753f-4544-aff3-d0e7170a1de1 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state building and task_state spawning.
Nov 14 20:48:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:48:36 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance spawned successfully.
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:48:36 user nova-compute[76442]: INFO nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:48:36 user nova-compute[76442]: INFO nova.compute.manager [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Took 11.51 seconds to build instance.
Nov 14 20:48:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-84350ebe-8451-4323-b0e6-d2da69d51ff1 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.670s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-90f6ef24-de0d-4d1d-9e9c-1c9b2f0ab1e0 req-64259553-6d6d-4c9f-8003-0d4d7dd8b4df service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-90f6ef24-de0d-4d1d-9e9c-1c9b2f0ab1e0 req-64259553-6d6d-4c9f-8003-0d4d7dd8b4df service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-90f6ef24-de0d-4d1d-9e9c-1c9b2f0ab1e0 req-64259553-6d6d-4c9f-8003-0d4d7dd8b4df service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-90f6ef24-de0d-4d1d-9e9c-1c9b2f0ab1e0 req-64259553-6d6d-4c9f-8003-0d4d7dd8b4df service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-90f6ef24-de0d-4d1d-9e9c-1c9b2f0ab1e0 req-64259553-6d6d-4c9f-8003-0d4d7dd8b4df service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:36 user nova-compute[76442]: WARNING nova.compute.manager [req-90f6ef24-de0d-4d1d-9e9c-1c9b2f0ab1e0 req-64259553-6d6d-4c9f-8003-0d4d7dd8b4df service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state active and task_state None.
Nov 14 20:48:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:38 user nova-compute[76442]: INFO nova.compute.manager [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Detaching volume c00d5cc3-ef46-4b65-a024-c466a8e51752
Nov 14 20:48:38 user nova-compute[76442]: INFO nova.virt.block_device [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Attempting to driver detach volume c00d5cc3-ef46-4b65-a024-c466a8e51752 from mountpoint /dev/vdb
Nov 14 20:48:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Attempting to detach device vdb from instance 447a1211-ebb6-4b4e-9207-047312e59f82 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:48:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:48:38 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:48:38 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:48:38 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:48:38 user nova-compute[76442]:   <serial>c00d5cc3-ef46-4b65-a024-c466a8e51752</serial>
Nov 14 20:48:38 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 20:48:38 user nova-compute[76442]: </disk>
Nov 14 20:48:38 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:48:38 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully detached device vdb from instance 447a1211-ebb6-4b4e-9207-047312e59f82 from the persistent domain config.
Nov 14 20:48:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 447a1211-ebb6-4b4e-9207-047312e59f82 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:48:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:48:38 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:48:38 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:48:38 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:48:38 user nova-compute[76442]:   <serial>c00d5cc3-ef46-4b65-a024-c466a8e51752</serial>
Nov 14 20:48:38 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 20:48:38 user nova-compute[76442]: </disk>
Nov 14 20:48:38 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:48:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 447a1211-ebb6-4b4e-9207-047312e59f82 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:48:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:51 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 is timed out.
Nov 14 20:48:51 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully detached device vdc from instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02 from the live domain config.
Nov 14 20:48:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kHOpWANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:48:51 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b815c-3b3d-4754-849e-18e89b25c8be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:48:51 user nova-compute[76442]: No targets found.
Nov 14 20:48:51 user nova-compute[76442]: iSNS:
Nov 14 20:48:51 user nova-compute[76442]: No targets found.
Nov 14 20:48:51 user nova-compute[76442]: STATIC:
Nov 14 20:48:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:48:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:48:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752
Nov 14 20:48:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:48:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a
Nov 14 20:48:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:51 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88
Nov 14 20:48:51 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:51 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:51 user nova-compute[76442]: FIRMWARE:
Nov 14 20:48:51 user nova-compute[76442]: No targets found.
Nov 14 20:48:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:48:51 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:48:51 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53e02ad-fb86-4ada-a42d-30ad85b2aba0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d8660b-cda5-41d8-b266-7771dab72a05]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:48:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a (non-flash)
Nov 14 20:48:51 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:48:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4e064d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a'): ({'sdg'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Removing single pathed devices sdg {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[55df81e2-fbfa-4431-9cdd-27cbc2faa591]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[07633046-e578-43a1-91dd-22e2224db8bf]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Flushing IO for device /dev/sdg {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74547d7-c3d2-49ce-aed7-bc7fbbbd6fcc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[754031ef-18b2-4799-8cda-37f689e432a0]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] SCSI volumes sdg have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[679621ef-496c-4137-a69e-6494a6b69568]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7569aa8d-9b54-4218-b13d-118cfc53faaf]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a, portal: 172.16.0.220,3260]
Nov 14 20:48:51 user nova-compute[76442]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a, portal: 172.16.0.220,3260] successful.
Nov 14 20:48:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86904328-7874-47ec-aa3d-4e0e1905538a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df51f54-a686-4d3e-94d4-91133d1a512f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] <== disconnect_volume: return (300ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:48:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:48:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:52 user nova-compute[76442]: DEBUG nova.objects.instance [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'flavor' on Instance uuid 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d47d43a9-99bf-4285-8eee-1c5839f0b56a tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.666s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:53 user nova-compute[76442]: INFO nova.compute.manager [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Terminating instance
Nov 14 20:48:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:48:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-6a37b69d-2f99-4b1d-b14b-1e2e101a9632 req-4f4157b5-a89a-4d89-94d8-7ad506d9d7fa service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received event network-vif-unplugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6a37b69d-2f99-4b1d-b14b-1e2e101a9632 req-4f4157b5-a89a-4d89-94d8-7ad506d9d7fa service nova] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6a37b69d-2f99-4b1d-b14b-1e2e101a9632 req-4f4157b5-a89a-4d89-94d8-7ad506d9d7fa service nova] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6a37b69d-2f99-4b1d-b14b-1e2e101a9632 req-4f4157b5-a89a-4d89-94d8-7ad506d9d7fa service nova] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-6a37b69d-2f99-4b1d-b14b-1e2e101a9632 req-4f4157b5-a89a-4d89-94d8-7ad506d9d7fa service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] No waiting events found dispatching network-vif-unplugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-6a37b69d-2f99-4b1d-b14b-1e2e101a9632 req-4f4157b5-a89a-4d89-94d8-7ad506d9d7fa service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received event network-vif-unplugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Instance destroyed successfully.
Nov 14 20:48:54 user nova-compute[76442]: DEBUG nova.objects.instance [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lazy-loading 'resources' on Instance uuid 4fbe4b37-bb70-4858-b79e-b44bab71cc02 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:45:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-923105165',display_name='tempest-AttachVolumeTestJSON-server-923105165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-923105165',id=29,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMo/bddgzApVpimsORBLTKgfPLNA4u8eBRkhBhMA+YD11qELb7te3KrbyenM6XWaf/BHgBb/4w/xun1XD5yfNnk1kjfRfIjHv1QBO5foZe5O006lr5MIondfwf5CJ1sNZw==',key_name='tempest-keypair-1367332533',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:46:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1e7d9ec7d5342a797576c7e568c1073',ramdisk_id='',reservation_id='r-xnv9f604',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-650801364',owner_user_name='tempest-AttachVolumeTestJSON-650801364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1451459113e244e798fff66799c10c48',uuid=4fbe4b37-bb70-4858-b79e-b44bab71cc02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converting VIF {"id": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "address": "fa:16:3e:1c:0a:7d", "network": {"id": "c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1202576824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1e7d9ec7d5342a797576c7e568c1073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c21af8e-26", "ovs_interfaceid": "4c21af8e-263d-47b2-827d-3c9c63c06ef9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:0a:7d,bridge_name='br-int',has_traffic_filtering=True,id=4c21af8e-263d-47b2-827d-3c9c63c06ef9,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c21af8e-26') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG os_vif [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:0a:7d,bridge_name='br-int',has_traffic_filtering=True,id=4c21af8e-263d-47b2-827d-3c9c63c06ef9,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c21af8e-26') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c21af8e-26, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4c616ac-3f75-4cc8-8b11-ca4858ce8fcd) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:54 user nova-compute[76442]: INFO os_vif [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:0a:7d,bridge_name='br-int',has_traffic_filtering=True,id=4c21af8e-263d-47b2-827d-3c9c63c06ef9,network=Network(c0d05bbf-5aaf-44e2-9a1b-2a157fd46b7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c21af8e-26')
Nov 14 20:48:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Deleting instance files /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02_del
Nov 14 20:48:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Deletion of /opt/stack/data/nova/instances/4fbe4b37-bb70-4858-b79e-b44bab71cc02_del complete
Nov 14 20:48:54 user nova-compute[76442]: INFO nova.compute.manager [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 20:48:54 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:48:54 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:48:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:55 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:48:55 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Took 0.71 seconds to deallocate network for instance.
Nov 14 20:48:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-9164a570-f01d-4b06-b3fc-9a27c65a4453 req-dd9e5a69-9467-4e73-8b0f-2bb24f24afaf service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received event network-vif-deleted-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:55 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:48:55 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:48:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:55 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Deleted allocations for instance 4fbe4b37-bb70-4858-b79e-b44bab71cc02
Nov 14 20:48:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d0a01e16-8835-453e-a3c7-811766a09407 tempest-AttachVolumeTestJSON-650801364 tempest-AttachVolumeTestJSON-650801364-project-member] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-aca8152d-4d89-46f6-b713-a5e922cb94e5 req-73d75282-fa3b-450b-b87d-bf685dbd7d93 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received event network-vif-plugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:48:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aca8152d-4d89-46f6-b713-a5e922cb94e5 req-73d75282-fa3b-450b-b87d-bf685dbd7d93 service nova] Acquiring lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:48:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aca8152d-4d89-46f6-b713-a5e922cb94e5 req-73d75282-fa3b-450b-b87d-bf685dbd7d93 service nova] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:48:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aca8152d-4d89-46f6-b713-a5e922cb94e5 req-73d75282-fa3b-450b-b87d-bf685dbd7d93 service nova] Lock "4fbe4b37-bb70-4858-b79e-b44bab71cc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:48:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-aca8152d-4d89-46f6-b713-a5e922cb94e5 req-73d75282-fa3b-450b-b87d-bf685dbd7d93 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] No waiting events found dispatching network-vif-plugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:48:56 user nova-compute[76442]: WARNING nova.compute.manager [req-aca8152d-4d89-46f6-b713-a5e922cb94e5 req-73d75282-fa3b-450b-b87d-bf685dbd7d93 service nova] [instance: 4fbe4b37-bb70-4858-b79e-b44bab71cc02] Received unexpected event network-vif-plugged-4c21af8e-263d-47b2-827d-3c9c63c06ef9 for instance with vm_state deleted and task_state None.
Nov 14 20:48:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:59 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 447a1211-ebb6-4b4e-9207-047312e59f82 is timed out.
Nov 14 20:48:59 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully detached device vdb from instance 447a1211-ebb6-4b4e-9207-047312e59f82 from the live domain config.
Nov 14 20:48:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BHUhNMiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:48:59 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[06db03c0-e868-4733-a926-14d4fc7f5dad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:48:59 user nova-compute[76442]: No targets found.
Nov 14 20:48:59 user nova-compute[76442]: iSNS:
Nov 14 20:48:59 user nova-compute[76442]: No targets found.
Nov 14 20:48:59 user nova-compute[76442]: STATIC:
Nov 14 20:48:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:48:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:48:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752
Nov 14 20:48:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:48:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88
Nov 14 20:48:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:48:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:48:59 user nova-compute[76442]: FIRMWARE:
Nov 14 20:48:59 user nova-compute[76442]: No targets found.
Nov 14 20:48:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:48:59 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:48:59 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e911b0-5d1b-4012-aa43-9f0c2b383088]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd64f7f-99cf-4177-80cf-c46b881c5e21]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:59 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:59 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:59 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:59 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:48:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:48:59 user nova-compute[76442]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 (non-flash)
Nov 14 20:48:59 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:48:59 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:48:59 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:48:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e873bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752'): ({'sde'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Removing single pathed devices sde {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b9889-0efa-4f8b-9500-e464664755ea]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c2c802-cc4e-4255-9bec-9d8e5d11ff5e]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flushing IO for device /dev/sde {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[23404603-de50-4506-abc8-bb040517412f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[08609a7f-77fe-408c-acfa-ef27f7f77182]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[63932359-7cce-4681-872d-c15fee26ae25]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af75a23-295c-4f6b-9de8-828330cdcedb]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260]
Nov 14 20:48:59 user nova-compute[76442]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752, portal: 172.16.0.220,3260] successful.
Nov 14 20:48:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c00d5cc3-ef46-4b65-a024-c466a8e51752 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f050ece-0a83-49c2-83b6-77d96604e151]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== disconnect_volume: return (312ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:48:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:49:00 user nova-compute[76442]: DEBUG nova.objects.instance [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'flavor' on Instance uuid 447a1211-ebb6-4b4e-9207-047312e59f82 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:49:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-becfe316-4139-41cd-a864-1a069dcccdb2 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.772s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:05 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:10 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:12 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:49:12 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7335MB free_disk=24.95782470703125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 88dd9488-e777-4b33-9702-e8f0353a62c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 447a1211-ebb6-4b4e-9207-047312e59f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 2458523e-c461-4cd5-903c-2d7ab0222162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 4aaca85e-1424-4feb-af15-a7d320fe0a18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a4a163ab-45ce-4db5-860c-61da5fe9b734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 16cd640b-de2b-488c-82d6-05c49cf526ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 90fb24a5-e12e-4192-b12a-17b95d6f5250 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:49:12 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:49:13 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:49:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:49:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:49:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 20:49:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:49:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:49:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:29 user nova-compute[76442]: INFO nova.compute.manager [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Terminating instance
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-39208f03-7bc5-4d61-affe-c45cf2bf60e2 req-b251eadb-7702-4925-8fa8-d88aafe5bb1b service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-unplugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-39208f03-7bc5-4d61-affe-c45cf2bf60e2 req-b251eadb-7702-4925-8fa8-d88aafe5bb1b service nova] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-39208f03-7bc5-4d61-affe-c45cf2bf60e2 req-b251eadb-7702-4925-8fa8-d88aafe5bb1b service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-39208f03-7bc5-4d61-affe-c45cf2bf60e2 req-b251eadb-7702-4925-8fa8-d88aafe5bb1b service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-39208f03-7bc5-4d61-affe-c45cf2bf60e2 req-b251eadb-7702-4925-8fa8-d88aafe5bb1b service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] No waiting events found dispatching network-vif-unplugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.compute.manager [req-39208f03-7bc5-4d61-affe-c45cf2bf60e2 req-b251eadb-7702-4925-8fa8-d88aafe5bb1b service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-unplugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Instance destroyed successfully.
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.objects.instance [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'resources' on Instance uuid 447a1211-ebb6-4b4e-9207-047312e59f82 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-499867076',display_name='tempest-ServerActionsTestOtherA-server-831548993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-499867076',id=27,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhvsEZC0bcnfS2UzsdizcTnu8K63xeTSWXSenE88qW4P2SVk+A6XJuerbfkhGBUpnBKQwDTJWQX3TBjWO9boLSj04YxQKsAqQ5X4QfVYbLp9D569QPjJG8Agn490Q7bnw==',key_name='tempest-keypair-1495363036',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:46:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-caelltby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:46:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=447a1211-ebb6-4b4e-9207-047312e59f82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "address": "fa:16:3e:f5:74:f7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa883b6df-bc", "ovs_interfaceid": "a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG os_vif [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa883b6df-bc, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c901127-d808-4401-9158-d201afd825f6) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:29 user nova-compute[76442]: INFO os_vif [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:74:f7,bridge_name='br-int',has_traffic_filtering=True,id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa883b6df-bc')
Nov 14 20:49:29 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Deleting instance files /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82_del
Nov 14 20:49:29 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Deletion of /opt/stack/data/nova/instances/447a1211-ebb6-4b4e-9207-047312e59f82_del complete
Nov 14 20:49:29 user nova-compute[76442]: INFO nova.compute.manager [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 20:49:29 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:49:29 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:49:30 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:49:30 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Took 1.03 seconds to deallocate network for instance.
Nov 14 20:49:30 user nova-compute[76442]: DEBUG nova.compute.manager [req-12b13f79-1cf7-4f89-8d24-27e175ab1e5c req-d7b33a05-eee7-47a9-9e65-5564ec924769 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-deleted-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:49:30 user nova-compute[76442]: INFO nova.compute.manager [req-12b13f79-1cf7-4f89-8d24-27e175ab1e5c req-d7b33a05-eee7-47a9-9e65-5564ec924769 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Neutron deleted interface a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7; detaching it from the instance and deleting it from the info cache
Nov 14 20:49:30 user nova-compute[76442]: DEBUG nova.network.neutron [req-12b13f79-1cf7-4f89-8d24-27e175ab1e5c req-d7b33a05-eee7-47a9-9e65-5564ec924769 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:49:30 user nova-compute[76442]: DEBUG nova.compute.manager [req-12b13f79-1cf7-4f89-8d24-27e175ab1e5c req-d7b33a05-eee7-47a9-9e65-5564ec924769 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Detach interface failed, port_id=a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7, reason: Instance 447a1211-ebb6-4b4e-9207-047312e59f82 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:49:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:31 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:49:31 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:49:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:31 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Deleted allocations for instance 447a1211-ebb6-4b4e-9207-047312e59f82
Nov 14 20:49:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-0d36c66b-b0b8-4b5d-af7b-3f49e8e2390d req-1f034cfd-8645-47ac-84e6-6b53617f5058 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:49:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0d36c66b-b0b8-4b5d-af7b-3f49e8e2390d req-1f034cfd-8645-47ac-84e6-6b53617f5058 service nova] Acquiring lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0d36c66b-b0b8-4b5d-af7b-3f49e8e2390d req-1f034cfd-8645-47ac-84e6-6b53617f5058 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0d36c66b-b0b8-4b5d-af7b-3f49e8e2390d req-1f034cfd-8645-47ac-84e6-6b53617f5058 service nova] Lock "447a1211-ebb6-4b4e-9207-047312e59f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-0d36c66b-b0b8-4b5d-af7b-3f49e8e2390d req-1f034cfd-8645-47ac-84e6-6b53617f5058 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] No waiting events found dispatching network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:49:31 user nova-compute[76442]: WARNING nova.compute.manager [req-0d36c66b-b0b8-4b5d-af7b-3f49e8e2390d req-1f034cfd-8645-47ac-84e6-6b53617f5058 service nova] [instance: 447a1211-ebb6-4b4e-9207-047312e59f82] Received unexpected event network-vif-plugged-a883b6df-bcf6-4df1-9c1b-f59a6f7ab6b7 for instance with vm_state deleted and task_state None.
Nov 14 20:49:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-2c399ebe-a38a-4d63-a832-5f0419d51f34 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "447a1211-ebb6-4b4e-9207-047312e59f82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.499s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:49:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 20:49:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:49:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:49:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'flavor' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:49:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:41 user nova-compute[76442]: INFO nova.compute.manager [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Attaching volume 61f700fb-ceed-4536-bc0e-a01a7063b587 to /dev/vdb
Nov 14 20:49:41 user nova-compute[76442]: DEBUG os_brick.utils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4047e348-9d05-45a8-acb0-521248dca253]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbbccc0-adc7-4513-b606-aa4fef5b8755]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58bb3dd-1932-4018-acbe-d60ba18f6320]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f9e23f-e786-49c5-9a04-94724e9b45e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:49:41 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:49:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca9566-379e-41a1-85f1-70bb68289f7f]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG os_brick.utils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:49:41 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updating existing volume attachment record: 1ed24519-6b12-4f25-ac36-91a35c084c6f {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:49:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:49:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iemCvEdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:49:51 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:49:51 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:49:51 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd319bbb-c974-4a87-bf46-2144ff6b4d1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:49:51 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d387bb-6ad6-45d2-b442-45b6487a4a89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587] added
Nov 14 20:49:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fcdf97-81f0-47b5-ac1d-0ae8aeca92ac]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e6bedf-c58f-47f0-b692-21f9e5b9ef17]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iemCvEdX {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iemCvEdX" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8fade-7833-4f4f-ae8f-311e37ff86c3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iemCvEdX'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa002953-6e2c-4951-8b1f-beb282a48ffd]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[127c6fca-d20a-4a2c-9f2d-3c07513bb8c7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e976d11d-b08d-47b0-a326-79d5bf27437d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260]
Nov 14 20:49:51 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260] successful.
Nov 14 20:49:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b5dcd-4576-40f3-b4c5-2f5864af8cf2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9ddee-facb-4463-8589-fbc408591775]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:49:51 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc49c6b-12a1-4ed4-ba1b-f666f3794d30]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:51 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:49:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:49:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iemCvEdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:49:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:49:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23936393231663638', 'path': '/dev/sde'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:49:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936393231663638', 'path': '/dev/sde'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:49:52 user nova-compute[76442]: DEBUG nova.objects.instance [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'flavor' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:49:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:49:52 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:49:52 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:49:52 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:49:52 user nova-compute[76442]:   <serial>61f700fb-ceed-4536-bc0e-a01a7063b587</serial>
Nov 14 20:49:52 user nova-compute[76442]: </disk>
Nov 14 20:49:52 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:49:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:49:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:49:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No VIF found with MAC fa:16:3e:f7:fb:3f, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:49:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-efe7f979-bb79-4ace-b6e4-9815fb6697de tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.042s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:56 user nova-compute[76442]: INFO nova.compute.manager [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Terminating instance
Nov 14 20:49:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Instance destroyed successfully.
Nov 14 20:49:57 user nova-compute[76442]: DEBUG nova.objects.instance [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lazy-loading 'resources' on Instance uuid 2458523e-c461-4cd5-903c-2d7ab0222162 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172479319',display_name='tempest-ServerActionsTestOtherB-server-172479319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172479319',id=23,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1w5ZQtpg99v5QhQpY/KBiq/xXDr7VzQC2xw087O/wNCNSflAIntMOx1Fw4GV4r8zvn0kw90vwhVLFroQhtXcr2jLFgnpFnY97fquWjOk/BVWAbsopYRXAkQYhcW7Uxdw==',key_name='tempest-keypair-1429056730',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:47:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05bc76da5dd841a88a4c8bba03e288aa',ramdisk_id='',reservation_id='r-fh10qe39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2105462622',owner_user_name='tempest-ServerActionsTestOtherB-2105462622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497dbbf201694a4e99ba98ebb9cf8e1a',uuid=2458523e-c461-4cd5-903c-2d7ab0222162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converting VIF {"id": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "address": "fa:16:3e:6f:d7:73", "network": {"id": "ffde0840-db2b-42ec-b3e7-0138ab646083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-238515712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bc76da5dd841a88a4c8bba03e288aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5ec5ad-76", "ovs_interfaceid": "9d5ec5ad-760e-438c-9e3b-b178e43f9e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_vif [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d5ec5ad-76, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=827ced81-b00f-4254-82d5-de5fa0cfe2a0) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:57 user nova-compute[76442]: INFO os_vif [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d7:73,bridge_name='br-int',has_traffic_filtering=True,id=9d5ec5ad-760e-438c-9e3b-b178e43f9e98,network=Network(ffde0840-db2b-42ec-b3e7-0138ab646083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5ec5ad-76')
Nov 14 20:49:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQFbkNXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:49:57 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-7d13a8a8-fc3c-415e-bb5d-dcd7fc552e9e req-f44c31fb-2735-4be3-9287-2eaaf270f6ee service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-unplugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7d13a8a8-fc3c-415e-bb5d-dcd7fc552e9e req-f44c31fb-2735-4be3-9287-2eaaf270f6ee service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7d13a8a8-fc3c-415e-bb5d-dcd7fc552e9e req-f44c31fb-2735-4be3-9287-2eaaf270f6ee service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7d13a8a8-fc3c-415e-bb5d-dcd7fc552e9e req-f44c31fb-2735-4be3-9287-2eaaf270f6ee service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-7d13a8a8-fc3c-415e-bb5d-dcd7fc552e9e req-f44c31fb-2735-4be3-9287-2eaaf270f6ee service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-unplugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-7d13a8a8-fc3c-415e-bb5d-dcd7fc552e9e req-f44c31fb-2735-4be3-9287-2eaaf270f6ee service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-unplugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf9101-1d45-47bc-b9df-477291965ff4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:49:57 user nova-compute[76442]: No targets found.
Nov 14 20:49:57 user nova-compute[76442]: iSNS:
Nov 14 20:49:57 user nova-compute[76442]: No targets found.
Nov 14 20:49:57 user nova-compute[76442]: STATIC:
Nov 14 20:49:57 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587
Nov 14 20:49:57 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:49:57 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:49:57 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:49:57 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:49:57 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:49:57 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a
Nov 14 20:49:57 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:49:57 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:49:57 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:49:57 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:49:57 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:49:57 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88
Nov 14 20:49:57 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:49:57 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:49:57 user nova-compute[76442]: FIRMWARE:
Nov 14 20:49:57 user nova-compute[76442]: No targets found.
Nov 14 20:49:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:49:57 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:49:57 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5996365a-c97e-4720-971c-5c1b31422e43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa27aa7-5949-4eb6-9473-4875fbc9d72b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:49:57 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:49:57 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:49:57 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:49:57 user nova-compute[76442]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:49:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:49:57 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:49:57 user nova-compute[76442]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a (non-flash)
Nov 14 20:49:57 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:49:57 user nova-compute[76442]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:49:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e84b39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce2269d-3de4-4f78-8b42-2762012fff10]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe1c910-96e4-4579-ab5d-281b30b28a7c]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbacd39-0567-4631-8ea0-5b9e993b849d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:49:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.086s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b1c04d-1e08-4cc0-a868-f4c3d59d7c79]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cabb650-daef-45ba-90d0-bceacbe0ec6f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bd6534-bbad-4805-b142-331b2ee22ae9]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260]
Nov 14 20:49:58 user nova-compute[76442]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a, portal: 172.16.0.220,3260] successful.
Nov 14 20:49:58 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e45b5f2-cc4b-4abd-b79b-64187c75978a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0039db8-2559-4474-ae76-7ac6bd9cddd4]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] <== disconnect_volume: return (368ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:49:58 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Deleting instance files /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162_del
Nov 14 20:49:58 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Deletion of /opt/stack/data/nova/instances/2458523e-c461-4cd5-903c-2d7ab0222162_del complete
Nov 14 20:49:58 user nova-compute[76442]: INFO nova.compute.manager [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 14 20:49:58 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:49:58 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-896ea459-1f6c-470e-a670-f20a66879218 req-0ec0fcbe-717a-4400-a2dc-463377eb2077 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-896ea459-1f6c-470e-a670-f20a66879218 req-0ec0fcbe-717a-4400-a2dc-463377eb2077 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing instance network info cache due to event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-896ea459-1f6c-470e-a670-f20a66879218 req-0ec0fcbe-717a-4400-a2dc-463377eb2077 service nova] Acquiring lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-896ea459-1f6c-470e-a670-f20a66879218 req-0ec0fcbe-717a-4400-a2dc-463377eb2077 service nova] Acquired lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG nova.network.neutron [req-896ea459-1f6c-470e-a670-f20a66879218 req-0ec0fcbe-717a-4400-a2dc-463377eb2077 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing network info cache for port 84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:49:59 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Took 0.92 seconds to deallocate network for instance.
Nov 14 20:49:59 user nova-compute[76442]: DEBUG nova.network.neutron [req-896ea459-1f6c-470e-a670-f20a66879218 req-0ec0fcbe-717a-4400-a2dc-463377eb2077 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updated VIF entry in instance network info cache for port 84f6b501-0b46-4c51-92da-2037bb8a1cf1. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG nova.network.neutron [req-896ea459-1f6c-470e-a670-f20a66879218 req-0ec0fcbe-717a-4400-a2dc-463377eb2077 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updating instance_info_cache with network_info: [{"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-896ea459-1f6c-470e-a670-f20a66879218 req-0ec0fcbe-717a-4400-a2dc-463377eb2077 service nova] Releasing lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ba8c5ae-1e78-4ab5-8fed-82177725bef0 req-084fe0ae-c75b-43ab-a158-c344b230d440 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ba8c5ae-1e78-4ab5-8fed-82177725bef0 req-084fe0ae-c75b-43ab-a158-c344b230d440 service nova] Acquiring lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ba8c5ae-1e78-4ab5-8fed-82177725bef0 req-084fe0ae-c75b-43ab-a158-c344b230d440 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ba8c5ae-1e78-4ab5-8fed-82177725bef0 req-084fe0ae-c75b-43ab-a158-c344b230d440 service nova] Lock "2458523e-c461-4cd5-903c-2d7ab0222162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:49:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ba8c5ae-1e78-4ab5-8fed-82177725bef0 req-084fe0ae-c75b-43ab-a158-c344b230d440 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] No waiting events found dispatching network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:49:59 user nova-compute[76442]: WARNING nova.compute.manager [req-6ba8c5ae-1e78-4ab5-8fed-82177725bef0 req-084fe0ae-c75b-43ab-a158-c344b230d440 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received unexpected event network-vif-plugged-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 for instance with vm_state active and task_state deleting.
Nov 14 20:49:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ba8c5ae-1e78-4ab5-8fed-82177725bef0 req-084fe0ae-c75b-43ab-a158-c344b230d440 service nova] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Received event network-vif-deleted-9d5ec5ad-760e-438c-9e3b-b178e43f9e98 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:49:59 user nova-compute[76442]: INFO nova.compute.manager [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] [instance: 2458523e-c461-4cd5-903c-2d7ab0222162] Took 0.82 seconds to detach 1 volumes for instance.
Nov 14 20:50:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:00 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:50:00 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:50:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:00 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Deleted allocations for instance 2458523e-c461-4cd5-903c-2d7ab0222162
Nov 14 20:50:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-17b61324-7295-4b8e-8634-a17021833af3 tempest-ServerActionsTestOtherB-2105462622 tempest-ServerActionsTestOtherB-2105462622-project-member] Lock "2458523e-c461-4cd5-903c-2d7ab0222162" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.811s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-8004afc8-84f7-4591-8459-8067b9e99eb9 req-7f6152dc-42db-4411-a06a-8c5321485ced service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-8004afc8-84f7-4591-8459-8067b9e99eb9 req-7f6152dc-42db-4411-a06a-8c5321485ced service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing instance network info cache due to event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8004afc8-84f7-4591-8459-8067b9e99eb9 req-7f6152dc-42db-4411-a06a-8c5321485ced service nova] Acquiring lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8004afc8-84f7-4591-8459-8067b9e99eb9 req-7f6152dc-42db-4411-a06a-8c5321485ced service nova] Acquired lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG nova.network.neutron [req-8004afc8-84f7-4591-8459-8067b9e99eb9 req-7f6152dc-42db-4411-a06a-8c5321485ced service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing network info cache for port 84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG nova.network.neutron [req-8004afc8-84f7-4591-8459-8067b9e99eb9 req-7f6152dc-42db-4411-a06a-8c5321485ced service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updated VIF entry in instance network info cache for port 84f6b501-0b46-4c51-92da-2037bb8a1cf1. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG nova.network.neutron [req-8004afc8-84f7-4591-8459-8067b9e99eb9 req-7f6152dc-42db-4411-a06a-8c5321485ced service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updating instance_info_cache with network_info: [{"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8004afc8-84f7-4591-8459-8067b9e99eb9 req-7f6152dc-42db-4411-a06a-8c5321485ced service nova] Releasing lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:04 user nova-compute[76442]: INFO nova.compute.manager [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Rebooting instance
Nov 14 20:50:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquired lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updating instance_info_cache with network_info: [{"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Releasing lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-0059056e-c190-44dd-a76d-4ec76f8741cc req-38beac4d-109a-4b0a-808e-ce617f20efd4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-unplugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0059056e-c190-44dd-a76d-4ec76f8741cc req-38beac4d-109a-4b0a-808e-ce617f20efd4 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0059056e-c190-44dd-a76d-4ec76f8741cc req-38beac4d-109a-4b0a-808e-ce617f20efd4 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0059056e-c190-44dd-a76d-4ec76f8741cc req-38beac4d-109a-4b0a-808e-ce617f20efd4 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-0059056e-c190-44dd-a76d-4ec76f8741cc req-38beac4d-109a-4b0a-808e-ce617f20efd4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-unplugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:04 user nova-compute[76442]: WARNING nova.compute.manager [req-0059056e-c190-44dd-a76d-4ec76f8741cc req-38beac4d-109a-4b0a-808e-ce617f20efd4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-unplugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 20:50:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Instance destroyed successfully.
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'resources' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2130661136',display_name='tempest-TestMinimumBasicScenario-server-2130661136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2130661136',id=31,image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFF+s/3VSD44gIlOirpYAcop6pTflhvSLdYoJMOJGvy3Rft7VgQfNPniWXQv57ySyOJq+6cHi724M/oBlIkiAq6OuRhTVWk3XsPmG2VNbyAHrdtq+ubZUOeC622l9KYIA==',key_name='tempest-TestMinimumBasicScenario-229484950',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dc5de9e6eaa43439c6d0b2b1c1dccf8',ramdisk_id='',reservation_id='r-3zp0ew5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1647137476',owner_user_name='tempest-TestMinimumBasicScenario-1647137476-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:50:05Z,user_data=None,user_id='45d53bb1eb4f416fa202ada14ba5ca10',uuid=a4a163ab-45ce-4db5-860c-61da5fe9b734,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converting VIF {"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_vif [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84f6b501-0b, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aacca9ba-ca29-438b-9321-cca532851177) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:05 user nova-compute[76442]: INFO os_vif [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b')
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iemCvEdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:50:05 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[add2356b-764a-40db-a4c0-f7b5aa3d70fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:50:05 user nova-compute[76442]: No targets found.
Nov 14 20:50:05 user nova-compute[76442]: iSNS:
Nov 14 20:50:05 user nova-compute[76442]: No targets found.
Nov 14 20:50:05 user nova-compute[76442]: STATIC:
Nov 14 20:50:05 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587
Nov 14 20:50:05 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:50:05 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:50:05 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:50:05 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:50:05 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:50:05 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:50:05 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:50:05 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:50:05 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88
Nov 14 20:50:05 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:50:05 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:50:05 user nova-compute[76442]: FIRMWARE:
Nov 14 20:50:05 user nova-compute[76442]: No targets found.
Nov 14 20:50:05 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:50:05 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:50:05 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fb5d2b-1e69-4a82-b96d-754b1e62ac74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[80968330-fccc-4ace-a21e-3ec05838762c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:05 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:05 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:05 user nova-compute[76442]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:05 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:05 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:05 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:05 user nova-compute[76442]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:05 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4d7aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587'): ({'sde'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Removing single pathed devices sde {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[430f15ae-1d77-4061-80fa-e888293081c4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da25d15-9946-4c5c-9f2e-bb492b186bc6]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Flushing IO for device /dev/sde {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d447b8a-f2ec-4d2a-a051-5946f1f2cbb3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[57962aec-1dff-4d46-9530-fc70d70583b1]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b7fcc-d62f-4f99-9c0d-23b3e78ece06]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[96356b50-51b7-483e-b7ef-d0df5bebc3dd]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260]
Nov 14 20:50:05 user nova-compute[76442]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260] successful.
Nov 14 20:50:05 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e510d4-db40-4b21-82fd-f893ced1e0a3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] <== disconnect_volume: return (307ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Start _get_guest_xml network_info=[{"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c047c0aa-4f92-4919-901e-be40e83724bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c047c0aa-4f92-4919-901e-be40e83724bc'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iemCvEdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a4a163ab-45ce-4db5-860c-61da5fe9b734', 'attached_at': '', 'detached_at': '', 'volume_id': '61f700fb-ceed-4536-bc0e-a01a7063b587', 'serial': '61f700fb-ceed-4536-bc0e-a01a7063b587'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'attachment_id': '1ed24519-6b12-4f25-ac36-91a35c084c6f', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:50:05 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:05 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c047c0aa-4f92-4919-901e-be40e83724bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.objects.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Object Instance<a4a163ab-45ce-4db5-860c-61da5fe9b734> lazy-loaded attributes: resources,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iemCvEdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:50:05 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:50:05 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:50:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:50:05 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:50:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66f6e49-d024-4b67-9891-47cd4b5b2e4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:50:06 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf06ab9e-3067-41b7-b413-5a3f6a952e59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587] added
Nov 14 20:50:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f23eab-1f8d-43e6-8fe6-74b2e66bcc1d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e03158-7741-4e69-a0da-94a2e88da48e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iemCvEdX {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iemCvEdX" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d33376-ee8e-4835-bdc6-f3910516a845]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iemCvEdX'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[715c9a9a-4ff0-451e-a98d-6e2a3859e301]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[03985671-42d6-4a55-8eaa-49442a945044]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[967c7053-a944-4350-a2f2-558a65b355fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260]
Nov 14 20:50:06 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260] successful.
Nov 14 20:50:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e8d1b9-953e-4035-8045-0d59572af128]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[092ff391-f7b9-4b1e-a027-b1843e569dc7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3799345e-7602-4c5a-b9e8-84bc8d382f97]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iemCvEdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-85676091-e68b-4be9-be7a-509a7961fb40 req-1944f1fe-d8f5-43ab-9556-365d9cf48548 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-85676091-e68b-4be9-be7a-509a7961fb40 req-1944f1fe-d8f5-43ab-9556-365d9cf48548 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-85676091-e68b-4be9-be7a-509a7961fb40 req-1944f1fe-d8f5-43ab-9556-365d9cf48548 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-85676091-e68b-4be9-be7a-509a7961fb40 req-1944f1fe-d8f5-43ab-9556-365d9cf48548 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-85676091-e68b-4be9-be7a-509a7961fb40 req-1944f1fe-d8f5-43ab-9556-365d9cf48548 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:06 user nova-compute[76442]: WARNING nova.compute.manager [req-85676091-e68b-4be9-be7a-509a7961fb40 req-1944f1fe-d8f5-43ab-9556-365d9cf48548 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 20:50:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23936393231663638', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936393231663638', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2130661136',display_name='tempest-TestMinimumBasicScenario-server-2130661136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2130661136',id=31,image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFF+s/3VSD44gIlOirpYAcop6pTflhvSLdYoJMOJGvy3Rft7VgQfNPniWXQv57ySyOJq+6cHi724M/oBlIkiAq6OuRhTVWk3XsPmG2VNbyAHrdtq+ubZUOeC622l9KYIA==',key_name='tempest-TestMinimumBasicScenario-229484950',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dc5de9e6eaa43439c6d0b2b1c1dccf8',ramdisk_id='',reservation_id='r-3zp0ew5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1647137476',owner_user_name='tempest-TestMinimumBasicScenario-1647137476-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:50:05Z,user_data=None,user_id='45d53bb1eb4f416fa202ada14ba5ca10',uuid=a4a163ab-45ce-4db5-860c-61da5fe9b734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converting VIF {"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'pci_devices' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.objects.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Object Instance<a4a163ab-45ce-4db5-860c-61da5fe9b734> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:50:07 user nova-compute[76442]:   <uuid>a4a163ab-45ce-4db5-860c-61da5fe9b734</uuid>
Nov 14 20:50:07 user nova-compute[76442]:   <name>instance-0000001f</name>
Nov 14 20:50:07 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:50:07 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:50:07 user nova-compute[76442]:   <metadata>
Nov 14 20:50:07 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:50:07 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:50:07 user nova-compute[76442]:       <nova:name>tempest-TestMinimumBasicScenario-server-2130661136</nova:name>
Nov 14 20:50:07 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:50:05</nova:creationTime>
Nov 14 20:50:07 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:50:07 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:50:07 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:50:07 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:50:07 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:50:07 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:50:07 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:50:07 user nova-compute[76442]:       <nova:owner>
Nov 14 20:50:07 user nova-compute[76442]:         <nova:user uuid="45d53bb1eb4f416fa202ada14ba5ca10">tempest-TestMinimumBasicScenario-1647137476-project-member</nova:user>
Nov 14 20:50:07 user nova-compute[76442]:         <nova:project uuid="3dc5de9e6eaa43439c6d0b2b1c1dccf8">tempest-TestMinimumBasicScenario-1647137476</nova:project>
Nov 14 20:50:07 user nova-compute[76442]:       </nova:owner>
Nov 14 20:50:07 user nova-compute[76442]:       <nova:root type="image" uuid="c047c0aa-4f92-4919-901e-be40e83724bc"/>
Nov 14 20:50:07 user nova-compute[76442]:       <nova:ports>
Nov 14 20:50:07 user nova-compute[76442]:         <nova:port uuid="84f6b501-0b46-4c51-92da-2037bb8a1cf1">
Nov 14 20:50:07 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 20:50:07 user nova-compute[76442]:         </nova:port>
Nov 14 20:50:07 user nova-compute[76442]:       </nova:ports>
Nov 14 20:50:07 user nova-compute[76442]:     </nova:instance>
Nov 14 20:50:07 user nova-compute[76442]:   </metadata>
Nov 14 20:50:07 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:50:07 user nova-compute[76442]:     <system>
Nov 14 20:50:07 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:50:07 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:50:07 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:50:07 user nova-compute[76442]:       <entry name="serial">a4a163ab-45ce-4db5-860c-61da5fe9b734</entry>
Nov 14 20:50:07 user nova-compute[76442]:       <entry name="uuid">a4a163ab-45ce-4db5-860c-61da5fe9b734</entry>
Nov 14 20:50:07 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:50:07 user nova-compute[76442]:     </system>
Nov 14 20:50:07 user nova-compute[76442]:   </sysinfo>
Nov 14 20:50:07 user nova-compute[76442]:   <os>
Nov 14 20:50:07 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:50:07 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:50:07 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:50:07 user nova-compute[76442]:   </os>
Nov 14 20:50:07 user nova-compute[76442]:   <features>
Nov 14 20:50:07 user nova-compute[76442]:     <acpi/>
Nov 14 20:50:07 user nova-compute[76442]:     <apic/>
Nov 14 20:50:07 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:50:07 user nova-compute[76442]:   </features>
Nov 14 20:50:07 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:50:07 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:50:07 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:50:07 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:50:07 user nova-compute[76442]:   </clock>
Nov 14 20:50:07 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:50:07 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:50:07 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:50:07 user nova-compute[76442]:   </cpu>
Nov 14 20:50:07 user nova-compute[76442]:   <devices>
Nov 14 20:50:07 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:50:07 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:50:07 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk"/>
Nov 14 20:50:07 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:50:07 user nova-compute[76442]:     </disk>
Nov 14 20:50:07 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:50:07 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:50:07 user nova-compute[76442]:       <source dev="/dev/sdd"/>
Nov 14 20:50:07 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:50:07 user nova-compute[76442]:       <serial>61f700fb-ceed-4536-bc0e-a01a7063b587</serial>
Nov 14 20:50:07 user nova-compute[76442]:     </disk>
Nov 14 20:50:07 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:50:07 user nova-compute[76442]:       <mac address="fa:16:3e:f7:fb:3f"/>
Nov 14 20:50:07 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:50:07 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:50:07 user nova-compute[76442]:       <target dev="tap84f6b501-0b"/>
Nov 14 20:50:07 user nova-compute[76442]:     </interface>
Nov 14 20:50:07 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:50:07 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/console.log" append="off"/>
Nov 14 20:50:07 user nova-compute[76442]:     </serial>
Nov 14 20:50:07 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:50:07 user nova-compute[76442]:     <video>
Nov 14 20:50:07 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:50:07 user nova-compute[76442]:     </video>
Nov 14 20:50:07 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:50:07 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:50:07 user nova-compute[76442]:     </rng>
Nov 14 20:50:07 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:50:07 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:50:07 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:50:07 user nova-compute[76442]:     </memballoon>
Nov 14 20:50:07 user nova-compute[76442]:   </devices>
Nov 14 20:50:07 user nova-compute[76442]: </domain>
Nov 14 20:50:07 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.objects.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Object Instance<a4a163ab-45ce-4db5-860c-61da5fe9b734> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28 --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:50:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Cannot resize image /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'migration_context' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG nova.objects.base [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Object Instance<a4a163ab-45ce-4db5-860c-61da5fe9b734> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2130661136',display_name='tempest-TestMinimumBasicScenario-server-2130661136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2130661136',id=31,image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFF+s/3VSD44gIlOirpYAcop6pTflhvSLdYoJMOJGvy3Rft7VgQfNPniWXQv57ySyOJq+6cHi724M/oBlIkiAq6OuRhTVWk3XsPmG2VNbyAHrdtq+ubZUOeC622l9KYIA==',key_name='tempest-TestMinimumBasicScenario-229484950',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3dc5de9e6eaa43439c6d0b2b1c1dccf8',ramdisk_id='',reservation_id='r-3zp0ew5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1647137476',owner_user_name='tempest-TestMinimumBasicScenario-1647137476-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:50:05Z,user_data=None,user_id='45d53bb1eb4f416fa202ada14ba5ca10',uuid=a4a163ab-45ce-4db5-860c-61da5fe9b734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converting VIF {"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG os_vif [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b4d302f-5d41-5c11-9b5a-f24f2c9460e8', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84f6b501-0b, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84f6b501-0b, col_values=(('qos', UUID('47899bd5-1dd4-4c4e-8f18-78fd0da2a088')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84f6b501-0b, col_values=(('external_ids', {'iface-id': '84f6b501-0b46-4c51-92da-2037bb8a1cf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:fb:3f', 'vm-uuid': 'a4a163ab-45ce-4db5-860c-61da5fe9b734'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:08 user nova-compute[76442]: INFO os_vif [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b')
Nov 14 20:50:08 user nova-compute[76442]: INFO nova.compute.manager [None req-59fc4a05-09ef-4a1b-9202-ee38236f93b8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Unrescuing
Nov 14 20:50:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59fc4a05-09ef-4a1b-9202-ee38236f93b8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59fc4a05-09ef-4a1b-9202-ee38236f93b8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquired lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG nova.network.neutron [None req-59fc4a05-09ef-4a1b-9202-ee38236f93b8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG nova.network.neutron [None req-59fc4a05-09ef-4a1b-9202-ee38236f93b8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Updating instance_info_cache with network_info: [{"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59fc4a05-09ef-4a1b-9202-ee38236f93b8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Releasing lock "refresh_cache-4aaca85e-1424-4feb-af15-a7d320fe0a18" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG nova.objects.instance [None req-59fc4a05-09ef-4a1b-9202-ee38236f93b8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'flavor' on Instance uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-b9881d22-cce9-433b-8d27-bfb7f129318a req-aecfa152-8680-4e3f-9d54-dcc0b2cebfdc service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b9881d22-cce9-433b-8d27-bfb7f129318a req-aecfa152-8680-4e3f-9d54-dcc0b2cebfdc service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b9881d22-cce9-433b-8d27-bfb7f129318a req-aecfa152-8680-4e3f-9d54-dcc0b2cebfdc service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b9881d22-cce9-433b-8d27-bfb7f129318a req-aecfa152-8680-4e3f-9d54-dcc0b2cebfdc service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-b9881d22-cce9-433b-8d27-bfb7f129318a req-aecfa152-8680-4e3f-9d54-dcc0b2cebfdc service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:09 user nova-compute[76442]: WARNING nova.compute.manager [req-b9881d22-cce9-433b-8d27-bfb7f129318a req-aecfa152-8680-4e3f-9d54-dcc0b2cebfdc service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:50:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-10327f4a-2d47-47ea-b264-3990de6e8d3e req-bf2fc469-67d2-4673-8a6c-fd8957006f50 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-10327f4a-2d47-47ea-b264-3990de6e8d3e req-bf2fc469-67d2-4673-8a6c-fd8957006f50 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-10327f4a-2d47-47ea-b264-3990de6e8d3e req-bf2fc469-67d2-4673-8a6c-fd8957006f50 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-10327f4a-2d47-47ea-b264-3990de6e8d3e req-bf2fc469-67d2-4673-8a6c-fd8957006f50 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG nova.compute.manager [req-10327f4a-2d47-47ea-b264-3990de6e8d3e req-bf2fc469-67d2-4673-8a6c-fd8957006f50 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:09 user nova-compute[76442]: WARNING nova.compute.manager [req-10327f4a-2d47-47ea-b264-3990de6e8d3e req-bf2fc469-67d2-4673-8a6c-fd8957006f50 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 20:50:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:10 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Instance destroyed successfully.
Nov 14 20:50:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.005s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.objects.instance [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'flavor' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:11 user nova-compute[76442]: WARNING nova.compute.manager [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-changed-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Refreshing instance network info cache due to event network-changed-ea269041-ffaf-4db5-93cf-170276a43527. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] Acquiring lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] Acquired lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.network.neutron [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Refreshing network info cache for port ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:11 user nova-compute[76442]: INFO nova.compute.manager [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Attaching volume e675f057-9fc6-47ee-9a10-c60d05e72b09 to /dev/vdb
Nov 14 20:50:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG os_brick.utils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd17682-5ac3-4304-9b47-4753d3a5b1dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee1205d-ce1a-4329-ad9d-87e1974bc579]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[57762ffb-c3b8-416d-bce6-c5769f52ba5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec7ce9e-5c09-408e-b552-e9b301b2917a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:50:11 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cd815d-96bf-4bd9-8771-df439a61b497]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG os_brick.utils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updating existing volume attachment record: d423ab99-60fc-438d-9d79-4c6f5e0d5b21 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.network.neutron [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updated VIF entry in instance network info cache for port ea269041-ffaf-4db5-93cf-170276a43527. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.network.neutron [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updating instance_info_cache with network_info: [{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-ba1d71f1-6853-456a-a8e1-fdc4086d12d7 req-6084be68-a263-4dba-a7a9-9bdd0c13106e service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba1d71f1-6853-456a-a8e1-fdc4086d12d7 req-6084be68-a263-4dba-a7a9-9bdd0c13106e service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba1d71f1-6853-456a-a8e1-fdc4086d12d7 req-6084be68-a263-4dba-a7a9-9bdd0c13106e service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba1d71f1-6853-456a-a8e1-fdc4086d12d7 req-6084be68-a263-4dba-a7a9-9bdd0c13106e service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-ba1d71f1-6853-456a-a8e1-fdc4086d12d7 req-6084be68-a263-4dba-a7a9-9bdd0c13106e service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:11 user nova-compute[76442]: WARNING nova.compute.manager [req-ba1d71f1-6853-456a-a8e1-fdc4086d12d7 req-6084be68-a263-4dba-a7a9-9bdd0c13106e service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 20:50:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3a7588fb-62c8-49d2-ac0f-c160f801a87e req-7fc4bf81-7acc-4994-b82b-6e6f27abe8fd service nova] Releasing lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:50:12 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Instance rebooted successfully.
Nov 14 20:50:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0776da11-928d-45e6-a739-63a1353f1766 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.983s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:13 user nova-compute[76442]: WARNING nova.compute.manager [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:50:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:13 user nova-compute[76442]: WARNING nova.compute.manager [req-704d6d82-8187-44df-b842-86da78d12524 req-e6a1c772-fb43-49b1-bc53-0d8627506644 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-59fc4a05-09ef-4a1b-9202-ee38236f93b8 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:16 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:16 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8021MB free_disk=24.99908447265625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 88dd9488-e777-4b33-9702-e8f0353a62c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 4aaca85e-1424-4feb-af15-a7d320fe0a18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a4a163ab-45ce-4db5-860c-61da5fe9b734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 16cd640b-de2b-488c-82d6-05c49cf526ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 90fb24a5-e12e-4192-b12a-17b95d6f5250 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:50:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-2b9377c9-d336-46f3-a58f-b1677df7933e req-50612eea-ddce-4c5a-a042-fde0bc5826a7 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-2b9377c9-d336-46f3-a58f-b1677df7933e req-50612eea-ddce-4c5a-a042-fde0bc5826a7 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing instance network info cache due to event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2b9377c9-d336-46f3-a58f-b1677df7933e req-50612eea-ddce-4c5a-a042-fde0bc5826a7 service nova] Acquiring lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2b9377c9-d336-46f3-a58f-b1677df7933e req-50612eea-ddce-4c5a-a042-fde0bc5826a7 service nova] Acquired lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG nova.network.neutron [req-2b9377c9-d336-46f3-a58f-b1677df7933e req-50612eea-ddce-4c5a-a042-fde0bc5826a7 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG nova.network.neutron [req-2b9377c9-d336-46f3-a58f-b1677df7933e req-50612eea-ddce-4c5a-a042-fde0bc5826a7 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updated VIF entry in instance network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG nova.network.neutron [req-2b9377c9-d336-46f3-a58f-b1677df7933e req-50612eea-ddce-4c5a-a042-fde0bc5826a7 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating instance_info_cache with network_info: [{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2b9377c9-d336-46f3-a58f-b1677df7933e req-50612eea-ddce-4c5a-a042-fde0bc5826a7 service nova] Releasing lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:17 user nova-compute[76442]: INFO nova.compute.manager [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Shelve offloading
Nov 14 20:50:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid a5970cb5-3f09-43c8-93ac-03053bc2f2cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-67e5de04-8396-4992-bc92-a94050676704 req-53e0f473-f15d-4f51-bed4-71899a89d13b service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-unplugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-67e5de04-8396-4992-bc92-a94050676704 req-53e0f473-f15d-4f51-bed4-71899a89d13b service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-67e5de04-8396-4992-bc92-a94050676704 req-53e0f473-f15d-4f51-bed4-71899a89d13b service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-67e5de04-8396-4992-bc92-a94050676704 req-53e0f473-f15d-4f51-bed4-71899a89d13b service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-67e5de04-8396-4992-bc92-a94050676704 req-53e0f473-f15d-4f51-bed4-71899a89d13b service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-unplugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:18 user nova-compute[76442]: WARNING nova.compute.manager [req-67e5de04-8396-4992-bc92-a94050676704 req-53e0f473-f15d-4f51-bed4-71899a89d13b service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-unplugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state active and task_state shelving.
Nov 14 20:50:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updating instance_info_cache with network_info: [{"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-a5970cb5-3f09-43c8-93ac-03053bc2f2cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:50:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance destroyed successfully.
Nov 14 20:50:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquired lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMRgkcxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:50:19 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:50:19 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:50:19 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf643b41-3bb1-4b8f-88b3-5875ee085933]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:50:19 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c78192-f933-45f4-88a4-d9d6b96194d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09] added
Nov 14 20:50:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG nova.network.neutron [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating instance_info_cache with network_info: [{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Releasing lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9080f5-5acb-4abb-a640-abd5d34b9598]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae607a4f-51be-4029-8914-2f2ad8418149]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMRgkcxY {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMRgkcxY" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b76a18-acd3-4fc7-bdce-bf4b73028d05]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMRgkcxY'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bd1e60-2441-4f59-a14c-824e4620ec57]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[739e739c-bfac-4efe-9d4f-a1fdff0a1259]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a000da68-e759-4fe0-a79e-d59af4e4ffce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09, portal: 172.16.0.220,3260]
Nov 14 20:50:19 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09, portal: 172.16.0.220,3260] successful.
Nov 14 20:50:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07c4040-86f8-4515-b4f8-ae6d2aa627a9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f126ac1-20df-4450-bf1a-3856d8b99f5d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:50:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0421084-501b-4edc-a543-04400d7ed44d]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:50:20 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance destroyed successfully.
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.objects.instance [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lazy-loading 'resources' on Instance uuid 90fb24a5-e12e-4192-b12a-17b95d6f5250 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397663843',display_name='tempest-TestShelveInstance-server-1397663843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397663843',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx67k1DDPkBdKiI3IbJAC1rHUUU1hvj9H2/3jxRrPH3KPX8Zazo8oOw6NCL9quWEjhLhomjnfyfczp4TnImA5DB7QwzhGoc55zWkGQo86KPclAZssCuejQOGlibcoHz6A==',key_name='tempest-TestShelveInstance-1392324859',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:48:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d797c60374a422eadb9e36efbe39c69',ramdisk_id='',reservation_id='r-8m12x60y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-371963907',owner_user_name='tempest-TestShelveInstance-371963907-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:48:36Z,user_data=None,user_id='5e32d699395a4756a1dc55d1450f0756',uuid=90fb24a5-e12e-4192-b12a-17b95d6f5250,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converting VIF {"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_vif [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b6a2b7a-dd, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d622286-110a-4b75-8cb6-0c763e383994) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-8e37d8a1-44e0-4e4c-b208-520a2eb3e42d req-ef4ee13c-cf1b-4c9b-ba18-201a18d5017c service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-8e37d8a1-44e0-4e4c-b208-520a2eb3e42d req-ef4ee13c-cf1b-4c9b-ba18-201a18d5017c service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing instance network info cache due to event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8e37d8a1-44e0-4e4c-b208-520a2eb3e42d req-ef4ee13c-cf1b-4c9b-ba18-201a18d5017c service nova] Acquiring lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8e37d8a1-44e0-4e4c-b208-520a2eb3e42d req-ef4ee13c-cf1b-4c9b-ba18-201a18d5017c service nova] Acquired lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.network.neutron [req-8e37d8a1-44e0-4e4c-b208-520a2eb3e42d req-ef4ee13c-cf1b-4c9b-ba18-201a18d5017c service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:50:20 user nova-compute[76442]: INFO os_vif [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd')
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkqjRMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:50:20 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-aec11597-3f65-4110-b208-1482006429d1 req-2d8e8a39-d6c4-4e66-ad91-1c4619dfbb14 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aec11597-3f65-4110-b208-1482006429d1 req-2d8e8a39-d6c4-4e66-ad91-1c4619dfbb14 service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aec11597-3f65-4110-b208-1482006429d1 req-2d8e8a39-d6c4-4e66-ad91-1c4619dfbb14 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aec11597-3f65-4110-b208-1482006429d1 req-2d8e8a39-d6c4-4e66-ad91-1c4619dfbb14 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-aec11597-3f65-4110-b208-1482006429d1 req-2d8e8a39-d6c4-4e66-ad91-1c4619dfbb14 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:20 user nova-compute[76442]: WARNING nova.compute.manager [req-aec11597-3f65-4110-b208-1482006429d1 req-2d8e8a39-d6c4-4e66-ad91-1c4619dfbb14 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state active and task_state shelving.
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.network.neutron [req-8e37d8a1-44e0-4e4c-b208-520a2eb3e42d req-ef4ee13c-cf1b-4c9b-ba18-201a18d5017c service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updated VIF entry in instance network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.network.neutron [req-8e37d8a1-44e0-4e4c-b208-520a2eb3e42d req-ef4ee13c-cf1b-4c9b-ba18-201a18d5017c service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating instance_info_cache with network_info: [{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": null, "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8e37d8a1-44e0-4e4c-b208-520a2eb3e42d req-ef4ee13c-cf1b-4c9b-ba18-201a18d5017c service nova] Releasing lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMRgkcxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23236353134633936', 'path': '/dev/sde'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236353134633936', 'path': '/dev/sde'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.560s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.objects.instance [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'flavor' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdfb08a-8a15-4964-8f70-89013d561082]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:50:20 user nova-compute[76442]: No targets found.
Nov 14 20:50:20 user nova-compute[76442]: iSNS:
Nov 14 20:50:20 user nova-compute[76442]: No targets found.
Nov 14 20:50:20 user nova-compute[76442]: STATIC:
Nov 14 20:50:20 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587
Nov 14 20:50:20 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:50:20 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:50:20 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:50:20 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:50:20 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:50:20 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:50:20 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:50:20 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:50:20 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:50:20 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:50:20 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:50:20 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88
Nov 14 20:50:20 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:50:20 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:50:20 user nova-compute[76442]: FIRMWARE:
Nov 14 20:50:20 user nova-compute[76442]: No targets found.
Nov 14 20:50:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:50:20 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:50:20 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:50:20 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:50:20 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:50:20 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:50:20 user nova-compute[76442]:   <serial>e675f057-9fc6-47ee-9a10-c60d05e72b09</serial>
Nov 14 20:50:20 user nova-compute[76442]: </disk>
Nov 14 20:50:20 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d339aba3-a195-4e3b-b875-05c158acb479]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e9b8ea-ff33-415f-8be9-97e5c08d6232]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:50:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e85af5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88'): ({'sdf'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Removing single pathed devices sdf {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eacae86-2170-49b9-800e-90ee0da8d489]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[013ac8b1-bfb3-4567-9831-9436d9932887]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Flushing IO for device /dev/sdf {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e351397b-3905-4104-ba3a-f429cd63ce94]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:50:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e3885-05e5-4f1c-9334-4aade4ccf511]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3d4cc5-c573-40eb-af65-b7711193d06e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccfec7e-c9a5-46e7-90d6-8241251cc31e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260]
Nov 14 20:50:21 user nova-compute[76442]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260] successful.
Nov 14 20:50:21 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[72304ca2-77a3-48c4-adb8-de25e75e54aa]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] <== disconnect_volume: return (963ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:50:21 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Deleting instance files /opt/stack/data/nova/instances/90fb24a5-e12e-4192-b12a-17b95d6f5250_del
Nov 14 20:50:21 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Deletion of /opt/stack/data/nova/instances/90fb24a5-e12e-4192-b12a-17b95d6f5250_del complete
Nov 14 20:50:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No VIF found with MAC fa:16:3e:97:fe:40, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:50:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-091a50a0-b26a-4acb-bb82-fe376ed7f8c6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.024s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:22 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Deleted allocations for instance 90fb24a5-e12e-4192-b12a-17b95d6f5250
Nov 14 20:50:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG nova.objects.instance [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lazy-loading 'numa_topology' on Instance uuid 90fb24a5-e12e-4192-b12a-17b95d6f5250 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG nova.objects.base [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Object Instance<90fb24a5-e12e-4192-b12a-17b95d6f5250> lazy-loaded attributes: resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cce4a6bb-689a-4f1f-92e0-c6f5c0dd459c tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.888s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:22 user nova-compute[76442]: INFO nova.compute.manager [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Rescuing
Nov 14 20:50:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquired lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:22 user nova-compute[76442]: DEBUG nova.network.neutron [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:50:23 user nova-compute[76442]: DEBUG nova.network.neutron [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updating instance_info_cache with network_info: [{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Releasing lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-4f697f5e-d9fd-46a0-af32-9b6f69fc130d req-8383471a-86a8-443b-893d-11cd67be2809 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4f697f5e-d9fd-46a0-af32-9b6f69fc130d req-8383471a-86a8-443b-893d-11cd67be2809 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4f697f5e-d9fd-46a0-af32-9b6f69fc130d req-8383471a-86a8-443b-893d-11cd67be2809 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4f697f5e-d9fd-46a0-af32-9b6f69fc130d req-8383471a-86a8-443b-893d-11cd67be2809 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-4f697f5e-d9fd-46a0-af32-9b6f69fc130d req-8383471a-86a8-443b-893d-11cd67be2809 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:23 user nova-compute[76442]: WARNING nova.compute.manager [req-4f697f5e-d9fd-46a0-af32-9b6f69fc130d req-8383471a-86a8-443b-893d-11cd67be2809 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state active and task_state rescuing.
Nov 14 20:50:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:24 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Instance destroyed successfully.
Nov 14 20:50:24 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Attempting rescue
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76442) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Instance directory exists: not creating {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 20:50:24 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Creating image(s)
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.instance [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue" returned: 0 in 0.054s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.instance [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'migration_context' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.base [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<16cd640b-de2b-488c-82d6-05c49cf526ef> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Start _get_guest_xml network_info=[{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "vif_mac": "fa:16:3e:97:fe:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.instance [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'resources' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.base [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<16cd640b-de2b-488c-82d6-05c49cf526ef> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.instance [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'numa_topology' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.base [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<16cd640b-de2b-488c-82d6-05c49cf526ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:24 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:24 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.instance [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.base [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<16cd640b-de2b-488c-82d6-05c49cf526ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1940446192',display_name='tempest-ServerRescueNegativeTestJSON-server-1940446192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1940446192',id=32,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgnXgFu74relfHlulTvLq9270uICYyFfK/4kFO7eURj/wtc1sNY6gK2CDVnpxY7VAiTVGE+O8mDzv3nEpSbG0x4Zmzimj0ejtyt0mW2iNwN6eAq6WVzhQJ3T53Qi32cLQ==',key_name='tempest-keypair-1017385623',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:48:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-x9vrzi8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d5a850b0e6c48359f78aa669b038897',uuid=16cd640b-de2b-488c-82d6-05c49cf526ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "vif_mac": "fa:16:3e:97:fe:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "vif_mac": "fa:16:3e:97:fe:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:fe:40,bridge_name='br-int',has_traffic_filtering=True,id=ea269041-ffaf-4db5-93cf-170276a43527,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea269041-ff') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.instance [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'pci_devices' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.objects.base [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Object Instance<16cd640b-de2b-488c-82d6-05c49cf526ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:50:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:50:24 user nova-compute[76442]:   <uuid>16cd640b-de2b-488c-82d6-05c49cf526ef</uuid>
Nov 14 20:50:24 user nova-compute[76442]:   <name>instance-00000020</name>
Nov 14 20:50:24 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:50:24 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:50:24 user nova-compute[76442]:   <metadata>
Nov 14 20:50:24 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:50:24 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:50:24 user nova-compute[76442]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1940446192</nova:name>
Nov 14 20:50:24 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:50:24</nova:creationTime>
Nov 14 20:50:24 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:50:24 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:50:24 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:50:24 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:50:24 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:50:24 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:50:24 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:50:24 user nova-compute[76442]:       <nova:owner>
Nov 14 20:50:24 user nova-compute[76442]:         <nova:user uuid="5d5a850b0e6c48359f78aa669b038897">tempest-ServerRescueNegativeTestJSON-916964129-project-member</nova:user>
Nov 14 20:50:24 user nova-compute[76442]:         <nova:project uuid="69cc7950cfcf40b180d65bc96e28a2e3">tempest-ServerRescueNegativeTestJSON-916964129</nova:project>
Nov 14 20:50:24 user nova-compute[76442]:       </nova:owner>
Nov 14 20:50:24 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:50:24 user nova-compute[76442]:       <nova:ports>
Nov 14 20:50:24 user nova-compute[76442]:         <nova:port uuid="ea269041-ffaf-4db5-93cf-170276a43527">
Nov 14 20:50:24 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:50:24 user nova-compute[76442]:         </nova:port>
Nov 14 20:50:24 user nova-compute[76442]:       </nova:ports>
Nov 14 20:50:24 user nova-compute[76442]:     </nova:instance>
Nov 14 20:50:24 user nova-compute[76442]:   </metadata>
Nov 14 20:50:24 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:50:24 user nova-compute[76442]:     <system>
Nov 14 20:50:24 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:50:24 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:50:24 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:50:24 user nova-compute[76442]:       <entry name="serial">16cd640b-de2b-488c-82d6-05c49cf526ef</entry>
Nov 14 20:50:24 user nova-compute[76442]:       <entry name="uuid">16cd640b-de2b-488c-82d6-05c49cf526ef</entry>
Nov 14 20:50:24 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:50:24 user nova-compute[76442]:     </system>
Nov 14 20:50:24 user nova-compute[76442]:   </sysinfo>
Nov 14 20:50:24 user nova-compute[76442]:   <os>
Nov 14 20:50:24 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:50:24 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:50:24 user nova-compute[76442]:   </os>
Nov 14 20:50:24 user nova-compute[76442]:   <features>
Nov 14 20:50:24 user nova-compute[76442]:     <acpi/>
Nov 14 20:50:24 user nova-compute[76442]:     <apic/>
Nov 14 20:50:24 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:50:24 user nova-compute[76442]:   </features>
Nov 14 20:50:24 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:50:24 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:50:24 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:50:24 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:50:24 user nova-compute[76442]:   </clock>
Nov 14 20:50:24 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:50:24 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:50:24 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:50:24 user nova-compute[76442]:   </cpu>
Nov 14 20:50:24 user nova-compute[76442]:   <devices>
Nov 14 20:50:24 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:50:24 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:50:24 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue"/>
Nov 14 20:50:24 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:50:24 user nova-compute[76442]:     </disk>
Nov 14 20:50:24 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:50:24 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:50:24 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk"/>
Nov 14 20:50:24 user nova-compute[76442]:       <target dev="vdb" bus="virtio"/>
Nov 14 20:50:24 user nova-compute[76442]:     </disk>
Nov 14 20:50:24 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:50:24 user nova-compute[76442]:       <mac address="fa:16:3e:97:fe:40"/>
Nov 14 20:50:24 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:50:24 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:50:24 user nova-compute[76442]:       <target dev="tapea269041-ff"/>
Nov 14 20:50:24 user nova-compute[76442]:     </interface>
Nov 14 20:50:24 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:50:24 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/console.log" append="off"/>
Nov 14 20:50:24 user nova-compute[76442]:     </serial>
Nov 14 20:50:24 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:50:24 user nova-compute[76442]:     <video>
Nov 14 20:50:24 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:50:24 user nova-compute[76442]:     </video>
Nov 14 20:50:24 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:50:24 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:50:24 user nova-compute[76442]:     </rng>
Nov 14 20:50:24 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:50:24 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:50:24 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:50:24 user nova-compute[76442]:     </memballoon>
Nov 14 20:50:24 user nova-compute[76442]:   </devices>
Nov 14 20:50:24 user nova-compute[76442]: </domain>
Nov 14 20:50:24 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:50:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:25 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Instance destroyed successfully.
Nov 14 20:50:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:50:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:50:25 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] No VIF found with MAC fa:16:3e:97:fe:40, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:50:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:26 user nova-compute[76442]: WARNING nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state active and task_state rescuing.
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:26 user nova-compute[76442]: WARNING nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state active and task_state rescuing.
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:26 user nova-compute[76442]: WARNING nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state active and task_state rescuing.
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:26 user nova-compute[76442]: WARNING nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state active and task_state rescuing.
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:26 user nova-compute[76442]: WARNING nova.compute.manager [req-e6950c48-1bd8-4383-bc0d-f46684aae89b req-ea7478a6-bbf0-45c5-b743-a5116df0764c service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state active and task_state rescuing.
Nov 14 20:50:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:28 user nova-compute[76442]: WARNING nova.compute.manager [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state active and task_state rescuing.
Nov 14 20:50:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:28 user nova-compute[76442]: WARNING nova.compute.manager [req-821dcf99-ae16-4592-bff7-2449e4796044 req-41891326-0aa5-4f20-81c6-51c35b211e3e service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state active and task_state rescuing.
Nov 14 20:50:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-18422e0c-3c91-479d-b4dc-275ffa7a2c5a tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:50:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:40 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:50:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:40 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:50:40 user nova-compute[76442]: INFO nova.compute.claims [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Claim successful on node user
Nov 14 20:50:41 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:50:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:50:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG nova.policy [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d28e5b4a8944d8090af18d0002c3bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d1c0e3197b48a5aaed41f156c1e7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:50:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Creating image(s)
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "/opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "/opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "/opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.196s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk 1073741824" returned: 0 in 0.054s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Successfully created port: c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Cannot resize image /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Ensure instance console log exists: /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Successfully updated port: c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "refresh_cache-e389a14f-286f-48d8-ae75-2b5bbadf3188" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquired lock "refresh_cache-e389a14f-286f-48d8-ae75-2b5bbadf3188" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-82783971-f5ee-42b4-b688-60da6a309ea5 req-2c71c2d9-4798-4667-93cf-6a0ea2b01652 service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received event network-changed-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-82783971-f5ee-42b4-b688-60da6a309ea5 req-2c71c2d9-4798-4667-93cf-6a0ea2b01652 service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Refreshing instance network info cache due to event network-changed-c56baf3f-0124-4538-875e-34afb3117ce2. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:50:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-82783971-f5ee-42b4-b688-60da6a309ea5 req-2c71c2d9-4798-4667-93cf-6a0ea2b01652 service nova] Acquiring lock "refresh_cache-e389a14f-286f-48d8-ae75-2b5bbadf3188" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Updating instance_info_cache with network_info: [{"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Releasing lock "refresh_cache-e389a14f-286f-48d8-ae75-2b5bbadf3188" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Instance network_info: |[{"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-82783971-f5ee-42b4-b688-60da6a309ea5 req-2c71c2d9-4798-4667-93cf-6a0ea2b01652 service nova] Acquired lock "refresh_cache-e389a14f-286f-48d8-ae75-2b5bbadf3188" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.network.neutron [req-82783971-f5ee-42b4-b688-60da6a309ea5 req-2c71c2d9-4798-4667-93cf-6a0ea2b01652 service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Refreshing network info cache for port c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Start _get_guest_xml network_info=[{"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:50:43 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:43 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-989618307',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-989618307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9896183',id=34,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF58tJS0OweKqeBz/TghzDrl0qhkyzUtafRlzEi/Owr/989N62l8R8IHqc8atx7YpiEAhA8eujmpqLorqIIHP88B8nnUG/G1uWqyDQ/vlxye+E528TmQcIyQlail4pQebQ==',key_name='tempest-keypair-175244924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38d1c0e3197b48a5aaed41f156c1e7f3',ramdisk_id='',reservation_id='r-cx7tr6k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1879144491',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d28e5b4a8944d8090af18d0002c3bac',uuid=e389a14f-286f-48d8-ae75-2b5bbadf3188,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Converting VIF {"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b6:21,bridge_name='br-int',has_traffic_filtering=True,id=c56baf3f-0124-4538-875e-34afb3117ce2,network=Network(09de3385-966a-46e7-b973-f4c2efc5bba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56baf3f-01') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.objects.instance [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lazy-loading 'pci_devices' on Instance uuid e389a14f-286f-48d8-ae75-2b5bbadf3188 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:50:43 user nova-compute[76442]:   <uuid>e389a14f-286f-48d8-ae75-2b5bbadf3188</uuid>
Nov 14 20:50:43 user nova-compute[76442]:   <name>instance-00000022</name>
Nov 14 20:50:43 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:50:43 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:50:43 user nova-compute[76442]:   <metadata>
Nov 14 20:50:43 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:50:43 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:50:43 user nova-compute[76442]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-989618307</nova:name>
Nov 14 20:50:43 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:50:43</nova:creationTime>
Nov 14 20:50:43 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:50:43 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:50:43 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:50:43 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:50:43 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:50:43 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:50:43 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:50:43 user nova-compute[76442]:       <nova:owner>
Nov 14 20:50:43 user nova-compute[76442]:         <nova:user uuid="4d28e5b4a8944d8090af18d0002c3bac">tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member</nova:user>
Nov 14 20:50:43 user nova-compute[76442]:         <nova:project uuid="38d1c0e3197b48a5aaed41f156c1e7f3">tempest-TestServerVolumeAttachScenarioOldVersion-1879144491</nova:project>
Nov 14 20:50:43 user nova-compute[76442]:       </nova:owner>
Nov 14 20:50:43 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:50:43 user nova-compute[76442]:       <nova:ports>
Nov 14 20:50:43 user nova-compute[76442]:         <nova:port uuid="c56baf3f-0124-4538-875e-34afb3117ce2">
Nov 14 20:50:43 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:50:43 user nova-compute[76442]:         </nova:port>
Nov 14 20:50:43 user nova-compute[76442]:       </nova:ports>
Nov 14 20:50:43 user nova-compute[76442]:     </nova:instance>
Nov 14 20:50:43 user nova-compute[76442]:   </metadata>
Nov 14 20:50:43 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:50:43 user nova-compute[76442]:     <system>
Nov 14 20:50:43 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:50:43 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:50:43 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:50:43 user nova-compute[76442]:       <entry name="serial">e389a14f-286f-48d8-ae75-2b5bbadf3188</entry>
Nov 14 20:50:43 user nova-compute[76442]:       <entry name="uuid">e389a14f-286f-48d8-ae75-2b5bbadf3188</entry>
Nov 14 20:50:43 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:50:43 user nova-compute[76442]:     </system>
Nov 14 20:50:43 user nova-compute[76442]:   </sysinfo>
Nov 14 20:50:43 user nova-compute[76442]:   <os>
Nov 14 20:50:43 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:50:43 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:50:43 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:50:43 user nova-compute[76442]:   </os>
Nov 14 20:50:43 user nova-compute[76442]:   <features>
Nov 14 20:50:43 user nova-compute[76442]:     <acpi/>
Nov 14 20:50:43 user nova-compute[76442]:     <apic/>
Nov 14 20:50:43 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:50:43 user nova-compute[76442]:   </features>
Nov 14 20:50:43 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:50:43 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:50:43 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:50:43 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:50:43 user nova-compute[76442]:   </clock>
Nov 14 20:50:43 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:50:43 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:50:43 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:50:43 user nova-compute[76442]:   </cpu>
Nov 14 20:50:43 user nova-compute[76442]:   <devices>
Nov 14 20:50:43 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:50:43 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:50:43 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk"/>
Nov 14 20:50:43 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:50:43 user nova-compute[76442]:     </disk>
Nov 14 20:50:43 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:50:43 user nova-compute[76442]:       <mac address="fa:16:3e:c7:b6:21"/>
Nov 14 20:50:43 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:50:43 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:50:43 user nova-compute[76442]:       <target dev="tapc56baf3f-01"/>
Nov 14 20:50:43 user nova-compute[76442]:     </interface>
Nov 14 20:50:43 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:50:43 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/console.log" append="off"/>
Nov 14 20:50:43 user nova-compute[76442]:     </serial>
Nov 14 20:50:43 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:50:43 user nova-compute[76442]:     <video>
Nov 14 20:50:43 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:50:43 user nova-compute[76442]:     </video>
Nov 14 20:50:43 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:50:43 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:50:43 user nova-compute[76442]:     </rng>
Nov 14 20:50:43 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:50:43 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:50:43 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:50:43 user nova-compute[76442]:     </memballoon>
Nov 14 20:50:43 user nova-compute[76442]:   </devices>
Nov 14 20:50:43 user nova-compute[76442]: </domain>
Nov 14 20:50:43 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-989618307',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-989618307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9896183',id=34,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF58tJS0OweKqeBz/TghzDrl0qhkyzUtafRlzEi/Owr/989N62l8R8IHqc8atx7YpiEAhA8eujmpqLorqIIHP88B8nnUG/G1uWqyDQ/vlxye+E528TmQcIyQlail4pQebQ==',key_name='tempest-keypair-175244924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38d1c0e3197b48a5aaed41f156c1e7f3',ramdisk_id='',reservation_id='r-cx7tr6k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1879144491',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d28e5b4a8944d8090af18d0002c3bac',uuid=e389a14f-286f-48d8-ae75-2b5bbadf3188,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Converting VIF {"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b6:21,bridge_name='br-int',has_traffic_filtering=True,id=c56baf3f-0124-4538-875e-34afb3117ce2,network=Network(09de3385-966a-46e7-b973-f4c2efc5bba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56baf3f-01') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG os_vif [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b6:21,bridge_name='br-int',has_traffic_filtering=True,id=c56baf3f-0124-4538-875e-34afb3117ce2,network=Network(09de3385-966a-46e7-b973-f4c2efc5bba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56baf3f-01') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a74d25ce-7564-59b8-8a6c-7d7d11eda4ab', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc56baf3f-01, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc56baf3f-01, col_values=(('qos', UUID('2cf21a1f-a685-447a-a8f4-53f0a6ffc298')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc56baf3f-01, col_values=(('external_ids', {'iface-id': 'c56baf3f-0124-4538-875e-34afb3117ce2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:b6:21', 'vm-uuid': 'e389a14f-286f-48d8-ae75-2b5bbadf3188'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:43 user nova-compute[76442]: INFO os_vif [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b6:21,bridge_name='br-int',has_traffic_filtering=True,id=c56baf3f-0124-4538-875e-34afb3117ce2,network=Network(09de3385-966a-46e7-b973-f4c2efc5bba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56baf3f-01')
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] No VIF found with MAC fa:16:3e:c7:b6:21, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.network.neutron [req-82783971-f5ee-42b4-b688-60da6a309ea5 req-2c71c2d9-4798-4667-93cf-6a0ea2b01652 service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Updated VIF entry in instance network info cache for port c56baf3f-0124-4538-875e-34afb3117ce2. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG nova.network.neutron [req-82783971-f5ee-42b4-b688-60da6a309ea5 req-2c71c2d9-4798-4667-93cf-6a0ea2b01652 service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Updating instance_info_cache with network_info: [{"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-82783971-f5ee-42b4-b688-60da6a309ea5 req-2c71c2d9-4798-4667-93cf-6a0ea2b01652 service nova] Releasing lock "refresh_cache-e389a14f-286f-48d8-ae75-2b5bbadf3188" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-f2c11a25-3bee-4809-a04a-76ef423074aa req-bc3be416-bf90-4a40-b926-470221db913c service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received event network-vif-plugged-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f2c11a25-3bee-4809-a04a-76ef423074aa req-bc3be416-bf90-4a40-b926-470221db913c service nova] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f2c11a25-3bee-4809-a04a-76ef423074aa req-bc3be416-bf90-4a40-b926-470221db913c service nova] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f2c11a25-3bee-4809-a04a-76ef423074aa req-bc3be416-bf90-4a40-b926-470221db913c service nova] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-f2c11a25-3bee-4809-a04a-76ef423074aa req-bc3be416-bf90-4a40-b926-470221db913c service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] No waiting events found dispatching network-vif-plugged-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:44 user nova-compute[76442]: WARNING nova.compute.manager [req-f2c11a25-3bee-4809-a04a-76ef423074aa req-bc3be416-bf90-4a40-b926-470221db913c service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received unexpected event network-vif-plugged-c56baf3f-0124-4538-875e-34afb3117ce2 for instance with vm_state building and task_state spawning.
Nov 14 20:50:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquiring lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:50:46 user nova-compute[76442]: INFO nova.compute.claims [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Claim successful on node user
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:50:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Instance spawned successfully.
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-ebe0ae6e-640e-4b59-a6ea-673bcb6b0067 req-016afd6b-38d8-4fbc-9574-324c109d1c9a service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received event network-vif-plugged-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ebe0ae6e-640e-4b59-a6ea-673bcb6b0067 req-016afd6b-38d8-4fbc-9574-324c109d1c9a service nova] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ebe0ae6e-640e-4b59-a6ea-673bcb6b0067 req-016afd6b-38d8-4fbc-9574-324c109d1c9a service nova] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ebe0ae6e-640e-4b59-a6ea-673bcb6b0067 req-016afd6b-38d8-4fbc-9574-324c109d1c9a service nova] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-ebe0ae6e-640e-4b59-a6ea-673bcb6b0067 req-016afd6b-38d8-4fbc-9574-324c109d1c9a service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] No waiting events found dispatching network-vif-plugged-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:46 user nova-compute[76442]: WARNING nova.compute.manager [req-ebe0ae6e-640e-4b59-a6ea-673bcb6b0067 req-016afd6b-38d8-4fbc-9574-324c109d1c9a service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received unexpected event network-vif-plugged-c56baf3f-0124-4538-875e-34afb3117ce2 for instance with vm_state building and task_state spawning.
Nov 14 20:50:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.network.neutron [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:50:46 user nova-compute[76442]: INFO nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:50:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:50:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:50:46 user nova-compute[76442]: INFO nova.compute.manager [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Took 6.09 seconds to build instance.
Nov 14 20:50:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4cf79d93-c249-4941-8025-340b65672354 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.173s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:50:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Creating image(s)
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "/opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "/opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG nova.policy [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d8b17fc9c1c4a218ac825b1c1494e8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63e31d496f7e42b48483ed48b31b8741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk 1073741824" returned: 0 in 0.058s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.190s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Cannot resize image /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Ensure instance console log exists: /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Successfully created port: 0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Successfully updated port: 0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquiring lock "refresh_cache-c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquired lock "refresh_cache-c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-b40fef53-c1ab-4374-b8dc-3715e12bb792 req-128f3e6e-e7b4-4c15-b556-a7006a553e3e service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received event network-changed-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-b40fef53-c1ab-4374-b8dc-3715e12bb792 req-128f3e6e-e7b4-4c15-b556-a7006a553e3e service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Refreshing instance network info cache due to event network-changed-0313297d-7f40-4085-ac93-12730209ec83. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b40fef53-c1ab-4374-b8dc-3715e12bb792 req-128f3e6e-e7b4-4c15-b556-a7006a553e3e service nova] Acquiring lock "refresh_cache-c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Updating instance_info_cache with network_info: [{"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Releasing lock "refresh_cache-c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Instance network_info: |[{"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b40fef53-c1ab-4374-b8dc-3715e12bb792 req-128f3e6e-e7b4-4c15-b556-a7006a553e3e service nova] Acquired lock "refresh_cache-c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.network.neutron [req-b40fef53-c1ab-4374-b8dc-3715e12bb792 req-128f3e6e-e7b4-4c15-b556-a7006a553e3e service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Refreshing network info cache for port 0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:50:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Start _get_guest_xml network_info=[{"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:50:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2076349630',display_name='tempest-VolumesNegativeTest-instance-2076349630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2076349630',id=35,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63e31d496f7e42b48483ed48b31b8741',ramdisk_id='',reservation_id='r-ah8ac5xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-66198869',owner_user_name='tempest-VolumesNegativeTest-66198869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:50:47Z,user_data=None,user_id='3d8b17fc9c1c4a218ac825b1c1494e8a',uuid=c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Converting VIF {"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fa:db,bridge_name='br-int',has_traffic_filtering=True,id=0313297d-7f40-4085-ac93-12730209ec83,network=Network(509f48af-3056-44f2-a364-e7619473953b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0313297d-7f') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.objects.instance [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lazy-loading 'pci_devices' on Instance uuid c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:50:49 user nova-compute[76442]:   <uuid>c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68</uuid>
Nov 14 20:50:49 user nova-compute[76442]:   <name>instance-00000023</name>
Nov 14 20:50:49 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:50:49 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:50:49 user nova-compute[76442]:   <metadata>
Nov 14 20:50:49 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:50:49 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:50:49 user nova-compute[76442]:       <nova:name>tempest-VolumesNegativeTest-instance-2076349630</nova:name>
Nov 14 20:50:49 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:50:49</nova:creationTime>
Nov 14 20:50:49 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:50:49 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:50:49 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:50:49 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:50:49 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:50:49 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:50:49 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:50:49 user nova-compute[76442]:       <nova:owner>
Nov 14 20:50:49 user nova-compute[76442]:         <nova:user uuid="3d8b17fc9c1c4a218ac825b1c1494e8a">tempest-VolumesNegativeTest-66198869-project-member</nova:user>
Nov 14 20:50:49 user nova-compute[76442]:         <nova:project uuid="63e31d496f7e42b48483ed48b31b8741">tempest-VolumesNegativeTest-66198869</nova:project>
Nov 14 20:50:49 user nova-compute[76442]:       </nova:owner>
Nov 14 20:50:49 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:50:49 user nova-compute[76442]:       <nova:ports>
Nov 14 20:50:49 user nova-compute[76442]:         <nova:port uuid="0313297d-7f40-4085-ac93-12730209ec83">
Nov 14 20:50:49 user nova-compute[76442]:           <nova:ip type="fixed" address="192.168.233.234" ipVersion="4"/>
Nov 14 20:50:49 user nova-compute[76442]:         </nova:port>
Nov 14 20:50:49 user nova-compute[76442]:       </nova:ports>
Nov 14 20:50:49 user nova-compute[76442]:     </nova:instance>
Nov 14 20:50:49 user nova-compute[76442]:   </metadata>
Nov 14 20:50:49 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:50:49 user nova-compute[76442]:     <system>
Nov 14 20:50:49 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:50:49 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:50:49 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:50:49 user nova-compute[76442]:       <entry name="serial">c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68</entry>
Nov 14 20:50:49 user nova-compute[76442]:       <entry name="uuid">c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68</entry>
Nov 14 20:50:49 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:50:49 user nova-compute[76442]:     </system>
Nov 14 20:50:49 user nova-compute[76442]:   </sysinfo>
Nov 14 20:50:49 user nova-compute[76442]:   <os>
Nov 14 20:50:49 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:50:49 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:50:49 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:50:49 user nova-compute[76442]:   </os>
Nov 14 20:50:49 user nova-compute[76442]:   <features>
Nov 14 20:50:49 user nova-compute[76442]:     <acpi/>
Nov 14 20:50:49 user nova-compute[76442]:     <apic/>
Nov 14 20:50:49 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:50:49 user nova-compute[76442]:   </features>
Nov 14 20:50:49 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:50:49 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:50:49 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:50:49 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:50:49 user nova-compute[76442]:   </clock>
Nov 14 20:50:49 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:50:49 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:50:49 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:50:49 user nova-compute[76442]:   </cpu>
Nov 14 20:50:49 user nova-compute[76442]:   <devices>
Nov 14 20:50:49 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:50:49 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:50:49 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk"/>
Nov 14 20:50:49 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:50:49 user nova-compute[76442]:     </disk>
Nov 14 20:50:49 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:50:49 user nova-compute[76442]:       <mac address="fa:16:3e:bd:fa:db"/>
Nov 14 20:50:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:50:49 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:50:49 user nova-compute[76442]:       <target dev="tap0313297d-7f"/>
Nov 14 20:50:49 user nova-compute[76442]:     </interface>
Nov 14 20:50:49 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:50:49 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/console.log" append="off"/>
Nov 14 20:50:49 user nova-compute[76442]:     </serial>
Nov 14 20:50:49 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:50:49 user nova-compute[76442]:     <video>
Nov 14 20:50:49 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:50:49 user nova-compute[76442]:     </video>
Nov 14 20:50:49 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:50:49 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:50:49 user nova-compute[76442]:     </rng>
Nov 14 20:50:49 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:50:49 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:50:49 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:50:49 user nova-compute[76442]:     </memballoon>
Nov 14 20:50:49 user nova-compute[76442]:   </devices>
Nov 14 20:50:49 user nova-compute[76442]: </domain>
Nov 14 20:50:49 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2076349630',display_name='tempest-VolumesNegativeTest-instance-2076349630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2076349630',id=35,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63e31d496f7e42b48483ed48b31b8741',ramdisk_id='',reservation_id='r-ah8ac5xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-66198869',owner_user_name='tempest-VolumesNegativeTest-66198869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:50:47Z,user_data=None,user_id='3d8b17fc9c1c4a218ac825b1c1494e8a',uuid=c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Converting VIF {"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fa:db,bridge_name='br-int',has_traffic_filtering=True,id=0313297d-7f40-4085-ac93-12730209ec83,network=Network(509f48af-3056-44f2-a364-e7619473953b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0313297d-7f') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG os_vif [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fa:db,bridge_name='br-int',has_traffic_filtering=True,id=0313297d-7f40-4085-ac93-12730209ec83,network=Network(509f48af-3056-44f2-a364-e7619473953b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0313297d-7f') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '733087d4-d083-5a6d-9cb3-1f3574e080eb', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0313297d-7f, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0313297d-7f, col_values=(('qos', UUID('b72b4fbc-5547-4d33-b19d-d9838456d27e')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0313297d-7f, col_values=(('external_ids', {'iface-id': '0313297d-7f40-4085-ac93-12730209ec83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:fa:db', 'vm-uuid': 'c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:49 user nova-compute[76442]: INFO os_vif [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fa:db,bridge_name='br-int',has_traffic_filtering=True,id=0313297d-7f40-4085-ac93-12730209ec83,network=Network(509f48af-3056-44f2-a364-e7619473953b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0313297d-7f')
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] No VIF found with MAC fa:16:3e:bd:fa:db, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.network.neutron [req-b40fef53-c1ab-4374-b8dc-3715e12bb792 req-128f3e6e-e7b4-4c15-b556-a7006a553e3e service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Updated VIF entry in instance network info cache for port 0313297d-7f40-4085-ac93-12730209ec83. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG nova.network.neutron [req-b40fef53-c1ab-4374-b8dc-3715e12bb792 req-128f3e6e-e7b4-4c15-b556-a7006a553e3e service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Updating instance_info_cache with network_info: [{"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:50:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b40fef53-c1ab-4374-b8dc-3715e12bb792 req-128f3e6e-e7b4-4c15-b556-a7006a553e3e service nova] Releasing lock "refresh_cache-c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:50:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-ba9bbf9f-10eb-4e77-b759-98d9cabd5818 req-a2390fc2-e740-4f3d-8500-eb2ad85d44f6 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received event network-vif-plugged-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba9bbf9f-10eb-4e77-b759-98d9cabd5818 req-a2390fc2-e740-4f3d-8500-eb2ad85d44f6 service nova] Acquiring lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba9bbf9f-10eb-4e77-b759-98d9cabd5818 req-a2390fc2-e740-4f3d-8500-eb2ad85d44f6 service nova] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ba9bbf9f-10eb-4e77-b759-98d9cabd5818 req-a2390fc2-e740-4f3d-8500-eb2ad85d44f6 service nova] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-ba9bbf9f-10eb-4e77-b759-98d9cabd5818 req-a2390fc2-e740-4f3d-8500-eb2ad85d44f6 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] No waiting events found dispatching network-vif-plugged-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:50 user nova-compute[76442]: WARNING nova.compute.manager [req-ba9bbf9f-10eb-4e77-b759-98d9cabd5818 req-a2390fc2-e740-4f3d-8500-eb2ad85d44f6 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received unexpected event network-vif-plugged-0313297d-7f40-4085-ac93-12730209ec83 for instance with vm_state building and task_state spawning.
Nov 14 20:50:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:50:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Instance spawned successfully.
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:50:52 user nova-compute[76442]: INFO nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63e9a080-672e-4f0a-ac2d-1acf79069512 req-7f27a949-eebd-49c9-ac63-8b4c245f9cd9 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received event network-vif-plugged-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63e9a080-672e-4f0a-ac2d-1acf79069512 req-7f27a949-eebd-49c9-ac63-8b4c245f9cd9 service nova] Acquiring lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63e9a080-672e-4f0a-ac2d-1acf79069512 req-7f27a949-eebd-49c9-ac63-8b4c245f9cd9 service nova] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63e9a080-672e-4f0a-ac2d-1acf79069512 req-7f27a949-eebd-49c9-ac63-8b4c245f9cd9 service nova] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63e9a080-672e-4f0a-ac2d-1acf79069512 req-7f27a949-eebd-49c9-ac63-8b4c245f9cd9 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] No waiting events found dispatching network-vif-plugged-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:50:52 user nova-compute[76442]: WARNING nova.compute.manager [req-63e9a080-672e-4f0a-ac2d-1acf79069512 req-7f27a949-eebd-49c9-ac63-8b4c245f9cd9 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received unexpected event network-vif-plugged-0313297d-7f40-4085-ac93-12730209ec83 for instance with vm_state building and task_state spawning.
Nov 14 20:50:52 user nova-compute[76442]: INFO nova.compute.manager [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Took 6.65 seconds to build instance.
Nov 14 20:50:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-378b3055-a92f-48a6-bc85-75c9ec63b18a tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.738s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:50:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:50:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:04 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 20:51:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 20:51:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:07 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:10 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:10 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:10 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:51:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:51:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:51:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:51:11 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updating instance_info_cache with network_info: [{"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-5253f642-7c49-4c03-8d13-5105497b4f5d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:16 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:51:16 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7462MB free_disk=24.92874526977539GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 88dd9488-e777-4b33-9702-e8f0353a62c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 4aaca85e-1424-4feb-af15-a7d320fe0a18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a4a163ab-45ce-4db5-860c-61da5fe9b734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 16cd640b-de2b-488c-82d6-05c49cf526ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e389a14f-286f-48d8-ae75-2b5bbadf3188 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 20:51:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 20:51:17 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:51:17 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:51:17 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:51:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.796s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:17 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 20:51:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_power_states {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid a5970cb5-3f09-43c8-93ac-03053bc2f2cc {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid e62b2506-c519-49bd-a678-0da035a6b1a9 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 88dd9488-e777-4b33-9702-e8f0353a62c6 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid e389a14f-286f-48d8-ae75-2b5bbadf3188 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "e62b2506-c519-49bd-a678-0da035a6b1a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "88dd9488-e777-4b33-9702-e8f0353a62c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.158s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.166s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.172s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:51:25 user nova-compute[76442]: INFO nova.compute.claims [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Claim successful on node user
Nov 14 20:51:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:51:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:51:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG nova.policy [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b873835b5e341c5aebfd4ded5f2c093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265a9c8786db48c78145d1388a5c321f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:51:26 user nova-compute[76442]: INFO nova.virt.block_device [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Booting with volume 6a9edb99-0c95-417a-938d-8a2a0353d6fe at /dev/vda
Nov 14 20:51:26 user nova-compute[76442]: DEBUG os_brick.utils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fffb6dd-c18b-4fa1-8502-e496411dc96b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[448d24a5-628d-4561-b7d8-f68f0411dd81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ece352-70c3-40fc-a77a-859fcb8d63d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3153cee3-49a5-4fe5-9b30-f74b4ead0825]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:51:26 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:51:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3820fce-321f-48ce-8509-1bb9f69a2b95]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG os_brick.utils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating existing volume attachment record: 7462f30d-4af3-45b3-b45e-e58aa5615029 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:51:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Successfully created port: 4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Successfully updated port: 4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquired lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-d1fcea47-b672-494a-8a4d-35ea99ccc6ab req-62fafd3d-73be-4c99-80b3-fdae3b6e95e9 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-changed-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG nova.compute.manager [req-d1fcea47-b672-494a-8a4d-35ea99ccc6ab req-62fafd3d-73be-4c99-80b3-fdae3b6e95e9 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Refreshing instance network info cache due to event network-changed-4059beb2-3592-4674-998b-eebf79ea5939. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1fcea47-b672-494a-8a4d-35ea99ccc6ab req-62fafd3d-73be-4c99-80b3-fdae3b6e95e9 service nova] Acquiring lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating instance_info_cache with network_info: [{"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Releasing lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Instance network_info: |[{"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1fcea47-b672-494a-8a4d-35ea99ccc6ab req-62fafd3d-73be-4c99-80b3-fdae3b6e95e9 service nova] Acquired lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:51:27 user nova-compute[76442]: DEBUG nova.network.neutron [req-d1fcea47-b672-494a-8a4d-35ea99ccc6ab req-62fafd3d-73be-4c99-80b3-fdae3b6e95e9 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Refreshing network info cache for port 4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:51:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-d1fcea47-b672-494a-8a4d-35ea99ccc6ab req-62fafd3d-73be-4c99-80b3-fdae3b6e95e9 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updated VIF entry in instance network info cache for port 4059beb2-3592-4674-998b-eebf79ea5939. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:51:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-d1fcea47-b672-494a-8a4d-35ea99ccc6ab req-62fafd3d-73be-4c99-80b3-fdae3b6e95e9 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating instance_info_cache with network_info: [{"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:51:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1fcea47-b672-494a-8a4d-35ea99ccc6ab req-62fafd3d-73be-4c99-80b3-fdae3b6e95e9 service nova] Releasing lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:51:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:51:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Creating image(s)
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Ensure instance console log exists: /opt/stack/data/nova/instances/211f5689-1c50-4638-a3e4-deeafc6013cc/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Start _get_guest_xml network_info=[{"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEHtinmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '211f5689-1c50-4638-a3e4-deeafc6013cc', 'attached_at': '', 'detached_at': '', 'volume_id': '6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'serial': '6a9edb99-0c95-417a-938d-8a2a0353d6fe'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '7462f30d-4af3-45b3-b45e-e58aa5615029', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:51:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:51:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEHtinmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:51:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:51:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:51:31 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef05a6b4-450b-4209-a4fd-92ff0cc7ca4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:51:31 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[43827c6f-8b6e-467c-9cc0-050c6e0f54cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe] added
Nov 14 20:51:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca1cf28-649d-4779-bb4c-1aa5785d46cd]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f73d1e-200a-43a3-8c47-5632e2837b8a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEHtinmL {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEHtinmL" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea5dbac-ff14-4f79-bbd7-2a34cb4a01ba]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oEHtinmL'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dff18a4-b57a-435d-ab5c-d5294e9d27ee]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39577e6-b601-4e60-8bf0-f60f70da7c5d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5785d7e-fd48-4786-b085-4aaf1db7f649]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260]
Nov 14 20:51:31 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260] successful.
Nov 14 20:51:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.127s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f5de74-3248-4743-a9e4-86da508e429c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc51df80-3522-4344-8ead-056205ed2ff2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:51:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:51:31 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:51:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[47632b52-b1a2-40a7-8b97-20f96d5f6274]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:51:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEHtinmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:51:32 user nova-compute[76442]: INFO nova.compute.claims [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Claim successful on node user
Nov 14 20:51:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26334663062346536', 'path': '/dev/sdf'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334663062346536', 'path': '/dev/sdf'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-152620928',display_name='tempest-ServerActionsTestOtherA-server-152620928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-152620928',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoMdApy2/8RPeA4MJeY2Nu8Fs1E5GIuT9rjXghW7E9nGEEJp3g35T0Y9hTYfuPiIewBxyfqXb2Q0ojDzSguW+OQkINVwKKH0JhOm94wxqmTbduWYc6NzfRIomyekkQ6+w==',key_name='tempest-keypair-553797527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-npnxfbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:51:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=211f5689-1c50-4638-a3e4-deeafc6013cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'pci_devices' on Instance uuid 211f5689-1c50-4638-a3e4-deeafc6013cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:51:32 user nova-compute[76442]:   <uuid>211f5689-1c50-4638-a3e4-deeafc6013cc</uuid>
Nov 14 20:51:32 user nova-compute[76442]:   <name>instance-00000024</name>
Nov 14 20:51:32 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:51:32 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:51:32 user nova-compute[76442]:   <metadata>
Nov 14 20:51:32 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:51:32 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:51:32 user nova-compute[76442]:       <nova:name>tempest-ServerActionsTestOtherA-server-152620928</nova:name>
Nov 14 20:51:32 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:51:31</nova:creationTime>
Nov 14 20:51:32 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:51:32 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:51:32 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:51:32 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:51:32 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:51:32 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:51:32 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:51:32 user nova-compute[76442]:       <nova:owner>
Nov 14 20:51:32 user nova-compute[76442]:         <nova:user uuid="3b873835b5e341c5aebfd4ded5f2c093">tempest-ServerActionsTestOtherA-887472165-project-member</nova:user>
Nov 14 20:51:32 user nova-compute[76442]:         <nova:project uuid="265a9c8786db48c78145d1388a5c321f">tempest-ServerActionsTestOtherA-887472165</nova:project>
Nov 14 20:51:32 user nova-compute[76442]:       </nova:owner>
Nov 14 20:51:32 user nova-compute[76442]:       <nova:ports>
Nov 14 20:51:32 user nova-compute[76442]:         <nova:port uuid="4059beb2-3592-4674-998b-eebf79ea5939">
Nov 14 20:51:32 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:51:32 user nova-compute[76442]:         </nova:port>
Nov 14 20:51:32 user nova-compute[76442]:       </nova:ports>
Nov 14 20:51:32 user nova-compute[76442]:     </nova:instance>
Nov 14 20:51:32 user nova-compute[76442]:   </metadata>
Nov 14 20:51:32 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:51:32 user nova-compute[76442]:     <system>
Nov 14 20:51:32 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:51:32 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:51:32 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:51:32 user nova-compute[76442]:       <entry name="serial">211f5689-1c50-4638-a3e4-deeafc6013cc</entry>
Nov 14 20:51:32 user nova-compute[76442]:       <entry name="uuid">211f5689-1c50-4638-a3e4-deeafc6013cc</entry>
Nov 14 20:51:32 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:51:32 user nova-compute[76442]:     </system>
Nov 14 20:51:32 user nova-compute[76442]:   </sysinfo>
Nov 14 20:51:32 user nova-compute[76442]:   <os>
Nov 14 20:51:32 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:51:32 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:51:32 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:51:32 user nova-compute[76442]:   </os>
Nov 14 20:51:32 user nova-compute[76442]:   <features>
Nov 14 20:51:32 user nova-compute[76442]:     <acpi/>
Nov 14 20:51:32 user nova-compute[76442]:     <apic/>
Nov 14 20:51:32 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:51:32 user nova-compute[76442]:   </features>
Nov 14 20:51:32 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:51:32 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:51:32 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:51:32 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:51:32 user nova-compute[76442]:   </clock>
Nov 14 20:51:32 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:51:32 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:51:32 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:51:32 user nova-compute[76442]:   </cpu>
Nov 14 20:51:32 user nova-compute[76442]:   <devices>
Nov 14 20:51:32 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:51:32 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:51:32 user nova-compute[76442]:       <source dev="/dev/sdf"/>
Nov 14 20:51:32 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:51:32 user nova-compute[76442]:       <serial>6a9edb99-0c95-417a-938d-8a2a0353d6fe</serial>
Nov 14 20:51:32 user nova-compute[76442]:     </disk>
Nov 14 20:51:32 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:51:32 user nova-compute[76442]:       <mac address="fa:16:3e:5f:c9:a7"/>
Nov 14 20:51:32 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:51:32 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:51:32 user nova-compute[76442]:       <target dev="tap4059beb2-35"/>
Nov 14 20:51:32 user nova-compute[76442]:     </interface>
Nov 14 20:51:32 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:51:32 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/211f5689-1c50-4638-a3e4-deeafc6013cc/console.log" append="off"/>
Nov 14 20:51:32 user nova-compute[76442]:     </serial>
Nov 14 20:51:32 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:51:32 user nova-compute[76442]:     <video>
Nov 14 20:51:32 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:51:32 user nova-compute[76442]:     </video>
Nov 14 20:51:32 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:51:32 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:51:32 user nova-compute[76442]:     </rng>
Nov 14 20:51:32 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:51:32 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:51:32 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:51:32 user nova-compute[76442]:     </memballoon>
Nov 14 20:51:32 user nova-compute[76442]:   </devices>
Nov 14 20:51:32 user nova-compute[76442]: </domain>
Nov 14 20:51:32 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-152620928',display_name='tempest-ServerActionsTestOtherA-server-152620928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-152620928',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoMdApy2/8RPeA4MJeY2Nu8Fs1E5GIuT9rjXghW7E9nGEEJp3g35T0Y9hTYfuPiIewBxyfqXb2Q0ojDzSguW+OQkINVwKKH0JhOm94wxqmTbduWYc6NzfRIomyekkQ6+w==',key_name='tempest-keypair-553797527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-npnxfbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:51:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=211f5689-1c50-4638-a3e4-deeafc6013cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG os_vif [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4d07d47-192d-546e-9d9c-a085a12593c9', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4059beb2-35, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4059beb2-35, col_values=(('qos', UUID('1559e3ea-5b0a-4b77-9260-ea1de3900522')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4059beb2-35, col_values=(('external_ids', {'iface-id': '4059beb2-3592-4674-998b-eebf79ea5939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:c9:a7', 'vm-uuid': '211f5689-1c50-4638-a3e4-deeafc6013cc'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:32 user nova-compute[76442]: INFO os_vif [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35')
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No VIF found with MAC fa:16:3e:5f:c9:a7, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:51:32 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:51:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG nova.policy [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd972568e27ee4a838e978c8d220699f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ecfb771a114113bdcdf1881fcb5f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:51:33 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Creating image(s)
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "/opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "/opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk 1073741824" returned: 0 in 0.048s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Successfully created port: 93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Cannot resize image /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Ensure instance console log exists: /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-41d2ad27-900d-4678-8493-97e42a99ea9f req-7e64e1b9-24b0-4bc3-98e1-88ebc5f51500 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-41d2ad27-900d-4678-8493-97e42a99ea9f req-7e64e1b9-24b0-4bc3-98e1-88ebc5f51500 service nova] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-41d2ad27-900d-4678-8493-97e42a99ea9f req-7e64e1b9-24b0-4bc3-98e1-88ebc5f51500 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-41d2ad27-900d-4678-8493-97e42a99ea9f req-7e64e1b9-24b0-4bc3-98e1-88ebc5f51500 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-41d2ad27-900d-4678-8493-97e42a99ea9f req-7e64e1b9-24b0-4bc3-98e1-88ebc5f51500 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] No waiting events found dispatching network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:51:34 user nova-compute[76442]: WARNING nova.compute.manager [req-41d2ad27-900d-4678-8493-97e42a99ea9f req-7e64e1b9-24b0-4bc3-98e1-88ebc5f51500 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received unexpected event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 for instance with vm_state building and task_state spawning.
Nov 14 20:51:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Successfully updated port: 93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "refresh_cache-5ac92e77-71c5-4aa5-bc70-ca5227a15e59" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquired lock "refresh_cache-5ac92e77-71c5-4aa5-bc70-ca5227a15e59" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-6befd5ac-2554-4abf-9234-25389216d8bc req-136632aa-2e11-4dfe-a0af-a2aedb82ca36 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received event network-changed-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-6befd5ac-2554-4abf-9234-25389216d8bc req-136632aa-2e11-4dfe-a0af-a2aedb82ca36 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Refreshing instance network info cache due to event network-changed-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6befd5ac-2554-4abf-9234-25389216d8bc req-136632aa-2e11-4dfe-a0af-a2aedb82ca36 service nova] Acquiring lock "refresh_cache-5ac92e77-71c5-4aa5-bc70-ca5227a15e59" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:51:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Updating instance_info_cache with network_info: [{"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Releasing lock "refresh_cache-5ac92e77-71c5-4aa5-bc70-ca5227a15e59" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Instance network_info: |[{"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6befd5ac-2554-4abf-9234-25389216d8bc req-136632aa-2e11-4dfe-a0af-a2aedb82ca36 service nova] Acquired lock "refresh_cache-5ac92e77-71c5-4aa5-bc70-ca5227a15e59" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-6befd5ac-2554-4abf-9234-25389216d8bc req-136632aa-2e11-4dfe-a0af-a2aedb82ca36 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Refreshing network info cache for port 93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Start _get_guest_xml network_info=[{"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:51:35 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:51:35 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1893255286',display_name='tempest-VolumesSnapshotTestJSON-instance-1893255286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1893255286',id=37,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiOZd4Jgj12km6KKHSY9D2iS+V+oaT3dZhRTFkGuK5Ce94NSr3V3ltDAlK1B1eWEIHPthBpOIqkGbT8INE24VKBo7h6SQlNgS57b6bDxs25wydyYN3WdJSxI51rfnV9CQ==',key_name='tempest-keypair-243117362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23ecfb771a114113bdcdf1881fcb5f62',ramdisk_id='',reservation_id='r-w62bsmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1708796007',owner_user_name='tempest-VolumesSnapshotTestJSON-1708796007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d972568e27ee4a838e978c8d220699f0',uuid=5ac92e77-71c5-4aa5-bc70-ca5227a15e59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converting VIF {"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9f:ca,bridge_name='br-int',has_traffic_filtering=True,id=93cc42aa-5a97-4ae7-aebb-bb1e8d90a081,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cc42aa-5a') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.objects.instance [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:51:35 user nova-compute[76442]:   <uuid>5ac92e77-71c5-4aa5-bc70-ca5227a15e59</uuid>
Nov 14 20:51:35 user nova-compute[76442]:   <name>instance-00000025</name>
Nov 14 20:51:35 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:51:35 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:51:35 user nova-compute[76442]:   <metadata>
Nov 14 20:51:35 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:51:35 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:51:35 user nova-compute[76442]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1893255286</nova:name>
Nov 14 20:51:35 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:51:35</nova:creationTime>
Nov 14 20:51:35 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:51:35 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:51:35 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:51:35 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:51:35 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:51:35 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:51:35 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:51:35 user nova-compute[76442]:       <nova:owner>
Nov 14 20:51:35 user nova-compute[76442]:         <nova:user uuid="d972568e27ee4a838e978c8d220699f0">tempest-VolumesSnapshotTestJSON-1708796007-project-member</nova:user>
Nov 14 20:51:35 user nova-compute[76442]:         <nova:project uuid="23ecfb771a114113bdcdf1881fcb5f62">tempest-VolumesSnapshotTestJSON-1708796007</nova:project>
Nov 14 20:51:35 user nova-compute[76442]:       </nova:owner>
Nov 14 20:51:35 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:51:35 user nova-compute[76442]:       <nova:ports>
Nov 14 20:51:35 user nova-compute[76442]:         <nova:port uuid="93cc42aa-5a97-4ae7-aebb-bb1e8d90a081">
Nov 14 20:51:35 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 20:51:35 user nova-compute[76442]:         </nova:port>
Nov 14 20:51:35 user nova-compute[76442]:       </nova:ports>
Nov 14 20:51:35 user nova-compute[76442]:     </nova:instance>
Nov 14 20:51:35 user nova-compute[76442]:   </metadata>
Nov 14 20:51:35 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:51:35 user nova-compute[76442]:     <system>
Nov 14 20:51:35 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:51:35 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:51:35 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:51:35 user nova-compute[76442]:       <entry name="serial">5ac92e77-71c5-4aa5-bc70-ca5227a15e59</entry>
Nov 14 20:51:35 user nova-compute[76442]:       <entry name="uuid">5ac92e77-71c5-4aa5-bc70-ca5227a15e59</entry>
Nov 14 20:51:35 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:51:35 user nova-compute[76442]:     </system>
Nov 14 20:51:35 user nova-compute[76442]:   </sysinfo>
Nov 14 20:51:35 user nova-compute[76442]:   <os>
Nov 14 20:51:35 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:51:35 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:51:35 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:51:35 user nova-compute[76442]:   </os>
Nov 14 20:51:35 user nova-compute[76442]:   <features>
Nov 14 20:51:35 user nova-compute[76442]:     <acpi/>
Nov 14 20:51:35 user nova-compute[76442]:     <apic/>
Nov 14 20:51:35 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:51:35 user nova-compute[76442]:   </features>
Nov 14 20:51:35 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:51:35 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:51:35 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:51:35 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:51:35 user nova-compute[76442]:   </clock>
Nov 14 20:51:35 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:51:35 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:51:35 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:51:35 user nova-compute[76442]:   </cpu>
Nov 14 20:51:35 user nova-compute[76442]:   <devices>
Nov 14 20:51:35 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:51:35 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:51:35 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk"/>
Nov 14 20:51:35 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:51:35 user nova-compute[76442]:     </disk>
Nov 14 20:51:35 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:51:35 user nova-compute[76442]:       <mac address="fa:16:3e:8e:9f:ca"/>
Nov 14 20:51:35 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:51:35 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:51:35 user nova-compute[76442]:       <target dev="tap93cc42aa-5a"/>
Nov 14 20:51:35 user nova-compute[76442]:     </interface>
Nov 14 20:51:35 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:51:35 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/console.log" append="off"/>
Nov 14 20:51:35 user nova-compute[76442]:     </serial>
Nov 14 20:51:35 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:51:35 user nova-compute[76442]:     <video>
Nov 14 20:51:35 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:51:35 user nova-compute[76442]:     </video>
Nov 14 20:51:35 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:51:35 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:51:35 user nova-compute[76442]:     </rng>
Nov 14 20:51:35 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:51:35 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:51:35 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:51:35 user nova-compute[76442]:     </memballoon>
Nov 14 20:51:35 user nova-compute[76442]:   </devices>
Nov 14 20:51:35 user nova-compute[76442]: </domain>
Nov 14 20:51:35 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1893255286',display_name='tempest-VolumesSnapshotTestJSON-instance-1893255286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1893255286',id=37,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiOZd4Jgj12km6KKHSY9D2iS+V+oaT3dZhRTFkGuK5Ce94NSr3V3ltDAlK1B1eWEIHPthBpOIqkGbT8INE24VKBo7h6SQlNgS57b6bDxs25wydyYN3WdJSxI51rfnV9CQ==',key_name='tempest-keypair-243117362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23ecfb771a114113bdcdf1881fcb5f62',ramdisk_id='',reservation_id='r-w62bsmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1708796007',owner_user_name='tempest-VolumesSnapshotTestJSON-1708796007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d972568e27ee4a838e978c8d220699f0',uuid=5ac92e77-71c5-4aa5-bc70-ca5227a15e59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converting VIF {"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9f:ca,bridge_name='br-int',has_traffic_filtering=True,id=93cc42aa-5a97-4ae7-aebb-bb1e8d90a081,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cc42aa-5a') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG os_vif [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9f:ca,bridge_name='br-int',has_traffic_filtering=True,id=93cc42aa-5a97-4ae7-aebb-bb1e8d90a081,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cc42aa-5a') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbb20035-d239-5dfa-8e0b-32cada7a4b8b', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93cc42aa-5a, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93cc42aa-5a, col_values=(('qos', UUID('5384db7f-d304-4b0b-8115-3ecbb519fd22')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93cc42aa-5a, col_values=(('external_ids', {'iface-id': '93cc42aa-5a97-4ae7-aebb-bb1e8d90a081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:9f:ca', 'vm-uuid': '5ac92e77-71c5-4aa5-bc70-ca5227a15e59'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:35 user nova-compute[76442]: INFO os_vif [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9f:ca,bridge_name='br-int',has_traffic_filtering=True,id=93cc42aa-5a97-4ae7-aebb-bb1e8d90a081,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cc42aa-5a')
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No VIF found with MAC fa:16:3e:8e:9f:ca, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-6befd5ac-2554-4abf-9234-25389216d8bc req-136632aa-2e11-4dfe-a0af-a2aedb82ca36 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Updated VIF entry in instance network info cache for port 93cc42aa-5a97-4ae7-aebb-bb1e8d90a081. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-6befd5ac-2554-4abf-9234-25389216d8bc req-136632aa-2e11-4dfe-a0af-a2aedb82ca36 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Updating instance_info_cache with network_info: [{"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:51:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6befd5ac-2554-4abf-9234-25389216d8bc req-136632aa-2e11-4dfe-a0af-a2aedb82ca36 service nova] Releasing lock "refresh_cache-5ac92e77-71c5-4aa5-bc70-ca5227a15e59" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:51:36 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Instance spawned successfully.
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:36 user nova-compute[76442]: INFO nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:51:36 user nova-compute[76442]: INFO nova.compute.manager [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Took 11.00 seconds to build instance.
Nov 14 20:51:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0ce34f38-854a-48cd-a8c2-804d1a5337f3 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.155s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-a6efcf56-eec4-40d3-a3e3-e2ca8ceff958 req-8481295c-8b01-4101-865c-a3871c31d479 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a6efcf56-eec4-40d3-a3e3-e2ca8ceff958 req-8481295c-8b01-4101-865c-a3871c31d479 service nova] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a6efcf56-eec4-40d3-a3e3-e2ca8ceff958 req-8481295c-8b01-4101-865c-a3871c31d479 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a6efcf56-eec4-40d3-a3e3-e2ca8ceff958 req-8481295c-8b01-4101-865c-a3871c31d479 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-a6efcf56-eec4-40d3-a3e3-e2ca8ceff958 req-8481295c-8b01-4101-865c-a3871c31d479 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] No waiting events found dispatching network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:51:36 user nova-compute[76442]: WARNING nova.compute.manager [req-a6efcf56-eec4-40d3-a3e3-e2ca8ceff958 req-8481295c-8b01-4101-865c-a3871c31d479 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received unexpected event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 for instance with vm_state active and task_state None.
Nov 14 20:51:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-c5ed46ce-b712-4248-9fd7-a4a894db1033 req-99027717-f0db-447b-b38d-bf74a067672d service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received event network-vif-plugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c5ed46ce-b712-4248-9fd7-a4a894db1033 req-99027717-f0db-447b-b38d-bf74a067672d service nova] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c5ed46ce-b712-4248-9fd7-a4a894db1033 req-99027717-f0db-447b-b38d-bf74a067672d service nova] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c5ed46ce-b712-4248-9fd7-a4a894db1033 req-99027717-f0db-447b-b38d-bf74a067672d service nova] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-c5ed46ce-b712-4248-9fd7-a4a894db1033 req-99027717-f0db-447b-b38d-bf74a067672d service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] No waiting events found dispatching network-vif-plugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:51:36 user nova-compute[76442]: WARNING nova.compute.manager [req-c5ed46ce-b712-4248-9fd7-a4a894db1033 req-99027717-f0db-447b-b38d-bf74a067672d service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received unexpected event network-vif-plugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 for instance with vm_state building and task_state spawning.
Nov 14 20:51:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:51:38 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Instance spawned successfully.
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:51:38 user nova-compute[76442]: INFO nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-aab6bf01-d8d0-4e71-b8f4-fea6a520dbc2 req-7178f927-701a-4a9d-b893-af21f867bb38 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received event network-vif-plugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aab6bf01-d8d0-4e71-b8f4-fea6a520dbc2 req-7178f927-701a-4a9d-b893-af21f867bb38 service nova] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aab6bf01-d8d0-4e71-b8f4-fea6a520dbc2 req-7178f927-701a-4a9d-b893-af21f867bb38 service nova] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aab6bf01-d8d0-4e71-b8f4-fea6a520dbc2 req-7178f927-701a-4a9d-b893-af21f867bb38 service nova] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-aab6bf01-d8d0-4e71-b8f4-fea6a520dbc2 req-7178f927-701a-4a9d-b893-af21f867bb38 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] No waiting events found dispatching network-vif-plugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:51:38 user nova-compute[76442]: WARNING nova.compute.manager [req-aab6bf01-d8d0-4e71-b8f4-fea6a520dbc2 req-7178f927-701a-4a9d-b893-af21f867bb38 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received unexpected event network-vif-plugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 for instance with vm_state building and task_state spawning.
Nov 14 20:51:39 user nova-compute[76442]: INFO nova.compute.manager [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Took 6.68 seconds to build instance.
Nov 14 20:51:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1b7537fb-1309-4bdd-8950-4f1c25872122 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.774s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-c8d918a1-03c0-4242-a285-97e1c1d9fb2f req-85f4cf14-1f9b-4993-9b19-8ef0b6fb958d service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:51:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-c8d918a1-03c0-4242-a285-97e1c1d9fb2f req-85f4cf14-1f9b-4993-9b19-8ef0b6fb958d service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing instance network info cache due to event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:51:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c8d918a1-03c0-4242-a285-97e1c1d9fb2f req-85f4cf14-1f9b-4993-9b19-8ef0b6fb958d service nova] Acquiring lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:51:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c8d918a1-03c0-4242-a285-97e1c1d9fb2f req-85f4cf14-1f9b-4993-9b19-8ef0b6fb958d service nova] Acquired lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:51:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-c8d918a1-03c0-4242-a285-97e1c1d9fb2f req-85f4cf14-1f9b-4993-9b19-8ef0b6fb958d service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing network info cache for port 84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:51:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-c8d918a1-03c0-4242-a285-97e1c1d9fb2f req-85f4cf14-1f9b-4993-9b19-8ef0b6fb958d service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updated VIF entry in instance network info cache for port 84f6b501-0b46-4c51-92da-2037bb8a1cf1. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:51:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-c8d918a1-03c0-4242-a285-97e1c1d9fb2f req-85f4cf14-1f9b-4993-9b19-8ef0b6fb958d service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updating instance_info_cache with network_info: [{"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:51:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c8d918a1-03c0-4242-a285-97e1c1d9fb2f req-85f4cf14-1f9b-4993-9b19-8ef0b6fb958d service nova] Releasing lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:51:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:56 user nova-compute[76442]: INFO nova.compute.manager [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Detaching volume 61f700fb-ceed-4536-bc0e-a01a7063b587
Nov 14 20:51:56 user nova-compute[76442]: INFO nova.virt.block_device [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Attempting to driver detach volume 61f700fb-ceed-4536-bc0e-a01a7063b587 from mountpoint /dev/vdb
Nov 14 20:51:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Attempting to detach device vdb from instance a4a163ab-45ce-4db5-860c-61da5fe9b734 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:51:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:51:56 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:51:56 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:51:56 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:51:56 user nova-compute[76442]:   <serial>61f700fb-ceed-4536-bc0e-a01a7063b587</serial>
Nov 14 20:51:56 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 20:51:56 user nova-compute[76442]: </disk>
Nov 14 20:51:56 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:51:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully detached device vdb from instance a4a163ab-45ce-4db5-860c-61da5fe9b734 from the persistent domain config.
Nov 14 20:51:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4a163ab-45ce-4db5-860c-61da5fe9b734 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:51:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:51:56 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:51:56 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:51:56 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:51:56 user nova-compute[76442]:   <serial>61f700fb-ceed-4536-bc0e-a01a7063b587</serial>
Nov 14 20:51:56 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 20:51:56 user nova-compute[76442]: </disk>
Nov 14 20:51:56 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:51:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:51:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-7cf17f0e-97aa-4219-9b01-7ed9ebf71784 req-b9eddec1-3994-40d9-9642-26650efe13c4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:51:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-7cf17f0e-97aa-4219-9b01-7ed9ebf71784 req-b9eddec1-3994-40d9-9642-26650efe13c4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing instance network info cache due to event network-changed-84f6b501-0b46-4c51-92da-2037bb8a1cf1. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:51:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7cf17f0e-97aa-4219-9b01-7ed9ebf71784 req-b9eddec1-3994-40d9-9642-26650efe13c4 service nova] Acquiring lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:51:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7cf17f0e-97aa-4219-9b01-7ed9ebf71784 req-b9eddec1-3994-40d9-9642-26650efe13c4 service nova] Acquired lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:51:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-7cf17f0e-97aa-4219-9b01-7ed9ebf71784 req-b9eddec1-3994-40d9-9642-26650efe13c4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Refreshing network info cache for port 84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:51:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-7cf17f0e-97aa-4219-9b01-7ed9ebf71784 req-b9eddec1-3994-40d9-9642-26650efe13c4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updated VIF entry in instance network info cache for port 84f6b501-0b46-4c51-92da-2037bb8a1cf1. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:51:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-7cf17f0e-97aa-4219-9b01-7ed9ebf71784 req-b9eddec1-3994-40d9-9642-26650efe13c4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updating instance_info_cache with network_info: [{"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:51:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7cf17f0e-97aa-4219-9b01-7ed9ebf71784 req-b9eddec1-3994-40d9-9642-26650efe13c4 service nova] Releasing lock "refresh_cache-a4a163ab-45ce-4db5-860c-61da5fe9b734" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:51:59 user nova-compute[76442]: INFO nova.compute.manager [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Terminating instance
Nov 14 20:51:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Instance destroyed successfully.
Nov 14 20:51:59 user nova-compute[76442]: DEBUG nova.objects.instance [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'resources' on Instance uuid 4aaca85e-1424-4feb-af15-a7d320fe0a18 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1978269637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1978269637',id=30,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:48:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-jqc0ymvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:50:14Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=4aaca85e-1424-4feb-af15-a7d320fe0a18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "ea6754df-28fe-4491-aaa4-a9c27388944a", "address": "fa:16:3e:49:46:73", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea6754df-28", "ovs_interfaceid": "ea6754df-28fe-4491-aaa4-a9c27388944a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:46:73,bridge_name='br-int',has_traffic_filtering=True,id=ea6754df-28fe-4491-aaa4-a9c27388944a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6754df-28') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_vif [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:46:73,bridge_name='br-int',has_traffic_filtering=True,id=ea6754df-28fe-4491-aaa4-a9c27388944a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6754df-28') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea6754df-28, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2ae8c24-6d14-4e8d-849b-356bdd873384) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: INFO os_vif [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:46:73,bridge_name='br-int',has_traffic_filtering=True,id=ea6754df-28fe-4491-aaa4-a9c27388944a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea6754df-28')
Nov 14 20:51:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyNfxHRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:51:59 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f8711-42d6-40f8-97a2-2e09ddf73bc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:51:59 user nova-compute[76442]: No targets found.
Nov 14 20:51:59 user nova-compute[76442]: iSNS:
Nov 14 20:51:59 user nova-compute[76442]: No targets found.
Nov 14 20:51:59 user nova-compute[76442]: STATIC:
Nov 14 20:51:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587
Nov 14 20:51:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:51:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:51:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3
Nov 14 20:51:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:51:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:51:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:51:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:51:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:51:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:51:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:51:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:51:59 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:51:59 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:51:59 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:51:59 user nova-compute[76442]: FIRMWARE:
Nov 14 20:51:59 user nova-compute[76442]: No targets found.
Nov 14 20:51:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:51:59 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:51:59 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db6c9f6-7658-4e1c-ab9b-560fe6370f9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc758c7-b928-4b7d-ad54-2eb285a60b2a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:51:59 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:51:59 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:51:59 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:51:59 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:51:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:51:59 user nova-compute[76442]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 (non-flash)
Nov 14 20:51:59 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:51:59 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:51:59 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:51:59 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0714fe6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:51:59 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dbcbe8-9fd5-4510-a1ca-d6758cde1303]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:00 user nova-compute[76442]: WARNING nova.compute.manager [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state active and task_state deleting.
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:00 user nova-compute[76442]: WARNING nova.compute.manager [req-588fe81d-fa06-45f9-9cce-5c0686cfcced req-52633d5f-6916-4a12-844c-b91c426d9c49 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state active and task_state deleting.
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f004822b-5a81-4398-b25c-c9d2a06f323d]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[297e5444-d1f8-4865-ae4c-a76f04de99ed]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[901cd9eb-1a6c-47b1-849b-4b9b177bd1d5]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7bba63-83bc-4108-88f8-a7194eebe0b6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2249f6-bece-4cc6-ba48-16e4bd866a51]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3, portal: 172.16.0.220,3260]
Nov 14 20:52:00 user nova-compute[76442]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3, portal: 172.16.0.220,3260] successful.
Nov 14 20:52:00 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c5a374-7a0a-4164-b59a-f5f0a6987cf3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bff0964-c7ee-4dd4-b466-d30da42a000e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] <== disconnect_volume: return (362ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:52:00 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Deleting instance files /opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18_del
Nov 14 20:52:00 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Deletion of /opt/stack/data/nova/instances/4aaca85e-1424-4feb-af15-a7d320fe0a18_del complete
Nov 14 20:52:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:00 user nova-compute[76442]: INFO nova.compute.manager [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 20:52:00 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:00 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Took 0.45 seconds to deallocate network for instance.
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-54dfefa8-9b26-4fc5-ba72-74fd245a76b3 req-98f6526a-a90e-41aa-80d0-41968cce8b56 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-deleted-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:00 user nova-compute[76442]: INFO nova.compute.manager [req-54dfefa8-9b26-4fc5-ba72-74fd245a76b3 req-98f6526a-a90e-41aa-80d0-41968cce8b56 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Neutron deleted interface ea6754df-28fe-4491-aaa4-a9c27388944a; detaching it from the instance and deleting it from the info cache
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.network.neutron [req-54dfefa8-9b26-4fc5-ba72-74fd245a76b3 req-98f6526a-a90e-41aa-80d0-41968cce8b56 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-54dfefa8-9b26-4fc5-ba72-74fd245a76b3 req-98f6526a-a90e-41aa-80d0-41968cce8b56 service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Detach interface failed, port_id=ea6754df-28fe-4491-aaa4-a9c27388944a, reason: Instance 4aaca85e-1424-4feb-af15-a7d320fe0a18 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:52:01 user nova-compute[76442]: INFO nova.compute.manager [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 20:52:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:01 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:52:01 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:52:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:01 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Deleted allocations for instance 4aaca85e-1424-4feb-af15-a7d320fe0a18
Nov 14 20:52:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-376c623c-1d65-4e57-b690-0d3ed31930ae tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.936s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:02 user nova-compute[76442]: WARNING nova.compute.manager [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state deleted and task_state None.
Nov 14 20:52:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:02 user nova-compute[76442]: WARNING nova.compute.manager [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-unplugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state deleted and task_state None.
Nov 14 20:52:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] Acquiring lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] Lock "4aaca85e-1424-4feb-af15-a7d320fe0a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] No waiting events found dispatching network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:02 user nova-compute[76442]: WARNING nova.compute.manager [req-1bf5e541-4a5e-4c6c-8f8e-eb39a7ee7a97 req-074bca19-98b4-4496-a3b0-b5c4e60ab26f service nova] [instance: 4aaca85e-1424-4feb-af15-a7d320fe0a18] Received unexpected event network-vif-plugged-ea6754df-28fe-4491-aaa4-a9c27388944a for instance with vm_state deleted and task_state None.
Nov 14 20:52:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:06 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:52:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:52:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:09 user nova-compute[76442]: INFO nova.compute.manager [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Unshelving
Nov 14 20:52:09 user nova-compute[76442]: INFO nova.virt.block_device [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Booting with volume aa18e9e6-8738-4939-a17e-b8f14cee1c88 at /dev/vda
Nov 14 20:52:09 user nova-compute[76442]: DEBUG os_brick.utils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4031d-c54c-4e4b-b627-42b9d8c1f974]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48ab735-9c64-4748-ac73-7fc7be81727d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[633f123f-44a8-42b0-bf61-2d66b2bf3e48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e446b3-b92d-4635-a585-275136d23cb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:52:09 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:52:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0036f1-e0b1-4a3b-a620-67d06832b67f]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG os_brick.utils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating existing volume attachment record: 2f5d273b-25d1-49a1-a7e4-ce4cb077b3ea {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:52:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:10 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:52:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:13 user nova-compute[76442]: INFO nova.compute.manager [None req-4a91c27a-0bee-4112-a5e3-eec158c62e2b tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Unrescuing
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4a91c27a-0bee-4112-a5e3-eec158c62e2b tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4a91c27a-0bee-4112-a5e3-eec158c62e2b tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquired lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4a91c27a-0bee-4112-a5e3-eec158c62e2b tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4a91c27a-0bee-4112-a5e3-eec158c62e2b tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updating instance_info_cache with network_info: [{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4a91c27a-0bee-4112-a5e3-eec158c62e2b tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Releasing lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG nova.objects.instance [None req-4a91c27a-0bee-4112-a5e3-eec158c62e2b tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'flavor' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lazy-loading 'pci_requests' on Instance uuid 90fb24a5-e12e-4192-b12a-17b95d6f5250 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-0c44b6fd-b93b-42ce-99b6-b429f3b2207e req-55cbdbbe-2ef3-41c3-8482-5875b8c93474 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0c44b6fd-b93b-42ce-99b6-b429f3b2207e req-55cbdbbe-2ef3-41c3-8482-5875b8c93474 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0c44b6fd-b93b-42ce-99b6-b429f3b2207e req-55cbdbbe-2ef3-41c3-8482-5875b8c93474 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0c44b6fd-b93b-42ce-99b6-b429f3b2207e req-55cbdbbe-2ef3-41c3-8482-5875b8c93474 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-0c44b6fd-b93b-42ce-99b6-b429f3b2207e req-55cbdbbe-2ef3-41c3-8482-5875b8c93474 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:14 user nova-compute[76442]: WARNING nova.compute.manager [req-0c44b6fd-b93b-42ce-99b6-b429f3b2207e req-55cbdbbe-2ef3-41c3-8482-5875b8c93474 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:52:14 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lazy-loading 'numa_topology' on Instance uuid 90fb24a5-e12e-4192-b12a-17b95d6f5250 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:52:14 user nova-compute[76442]: INFO nova.compute.claims [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Claim successful on node user
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Instance destroyed successfully.
Nov 14 20:52:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.746s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:15 user nova-compute[76442]: INFO nova.network.neutron [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquired lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:16 user nova-compute[76442]: WARNING nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:16 user nova-compute[76442]: WARNING nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:16 user nova-compute[76442]: WARNING nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:16 user nova-compute[76442]: WARNING nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:16 user nova-compute[76442]: WARNING nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing instance network info cache due to event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Acquiring lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4a163ab-45ce-4db5-860c-61da5fe9b734 is timed out.
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:18 user nova-compute[76442]: WARNING nova.compute.manager [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:18 user nova-compute[76442]: WARNING nova.compute.manager [req-51d8f647-455e-47b9-a315-3891f0ba43b3 req-346ef886-9eb4-4aa5-8998-5e6fabd9c352 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state rescued and task_state unrescuing.
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4a91c27a-0bee-4112-a5e3-eec158c62e2b tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:52:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully detached device vdb from instance a4a163ab-45ce-4db5-860c-61da5fe9b734 from the live domain config.
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iemCvEdX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:52:18 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:52:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:52:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7370MB free_disk=24.894515991210938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5212ac-bca8-4f0e-98f3-c2f958a71d02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:52:18 user nova-compute[76442]: No targets found.
Nov 14 20:52:18 user nova-compute[76442]: iSNS:
Nov 14 20:52:18 user nova-compute[76442]: No targets found.
Nov 14 20:52:18 user nova-compute[76442]: STATIC:
Nov 14 20:52:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587
Nov 14 20:52:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:52:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:52:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:52:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:52:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:52:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:52:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:52:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:52:18 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:52:18 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:52:18 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:52:18 user nova-compute[76442]: FIRMWARE:
Nov 14 20:52:18 user nova-compute[76442]: No targets found.
Nov 14 20:52:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:52:18 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:52:18 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating instance_info_cache with network_info: [{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b37867e-62d3-4c2d-8bd7-e09e257b4694]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Releasing lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:52:18 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Creating image(s)
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Ensure instance console log exists: /opt/stack/data/nova/instances/90fb24a5-e12e-4192-b12a-17b95d6f5250/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Start _get_guest_xml network_info=[{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkqjRMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90fb24a5-e12e-4192-b12a-17b95d6f5250', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'serial': 'aa18e9e6-8738-4939-a17e-b8f14cee1c88'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '2f5d273b-25d1-49a1-a7e4-ce4cb077b3ea', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Acquired lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:52:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[36418795-68b4-4da6-afda-cee3a91ee921]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:18 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:52:18 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:18 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:18 user nova-compute[76442]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 (non-flash)
Nov 14 20:52:18 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:18 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4fef520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90fb24a5-e12e-4192-b12a-17b95d6f5250 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f3e922-1353-49e8-b016-d82dd3b2023f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:18 user nova-compute[76442]: DEBUG nova.objects.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Object Instance<90fb24a5-e12e-4192-b12a-17b95d6f5250> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkqjRMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:52:19 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 88dd9488-e777-4b33-9702-e8f0353a62c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a4a163ab-45ce-4db5-860c-61da5fe9b734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 16cd640b-de2b-488c-82d6-05c49cf526ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e389a14f-286f-48d8-ae75-2b5bbadf3188 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 211f5689-1c50-4638-a3e4-deeafc6013cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (8fc56580-8aa8-4b89-aaa5-43465a1eed3f): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2876dc77-14d4-416c-9ee2-926965203cad]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa513ba-7d2a-4719-9d91-75d235c1d74d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a5e2c6-f4e3-484d-9706-2e8910b9ecfd]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a99719c-ddaa-4784-b685-bd7997913d52]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[44256ee8-cb6c-4db7-aec4-f93c3636c7dd]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260]
Nov 14 20:52:19 user nova-compute[76442]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587, portal: 172.16.0.220,3260] successful.
Nov 14 20:52:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f700fb-ceed-4536-bc0e-a01a7063b587 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[63380ab9-2eae-4777-a3a8-50e5b6b305a1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] <== disconnect_volume: return (375ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.220s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:52:19 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:52:19 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b40fc8-5438-4a0d-a3d7-8d4743b30e3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:52:19 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6f92a7-b598-4b1a-b754-9b036be73c4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88] added
Nov 14 20:52:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c1879e-c3b4-4b2f-94a5-328a6b732499]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28472b1-617e-40bc-8a8c-29e869fec26f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkqjRMID {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.network.neutron [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updated VIF entry in instance network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.network.neutron [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating instance_info_cache with network_info: [{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkqjRMID" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f0e853-570e-40fd-9765-25b7b887d980]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SkqjRMID'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5d147e79-2d35-4ef4-93ed-95e8e80f2305 req-e11755b4-c8da-4133-ad9f-30e0a42909c1 service nova] Releasing lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfe44b7-19e8-466e-aab2-3f2cddb18399]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7e3e79-0a39-4f81-8c97-3207d0948559]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27166ef-2b54-4554-bfb8-a1f6dfe65920]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260]
Nov 14 20:52:19 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260] successful.
Nov 14 20:52:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da28946-bb93-41e7-987d-929d41bc2d97]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a34bffc-e1f2-47e7-84a8-19fe79228bd7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:19 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:52:19 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9c2b0d-1562-43e4-931a-26e4350984f9]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:52:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.objects.instance [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'flavor' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bab701bb-d8f4-47e4-84cb-a8e1d0d270d5 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.212s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkqjRMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] <== connect_volume: return (1550ms) {'type': 'block', 'scsi_wwn': '23136656430303335', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136656430303335', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397663843',display_name='tempest-TestShelveInstance-server-1397663843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397663843',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1392324859',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:48:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d797c60374a422eadb9e36efbe39c69',ramdisk_id='',reservation_id='r-8m12x60y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-371963907',owner_user_name='tempest-TestShelveInstance-371963907-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:52:10Z,user_data=None,user_id='5e32d699395a4756a1dc55d1450f0756',uuid=90fb24a5-e12e-4192-b12a-17b95d6f5250,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converting VIF {"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lazy-loading 'pci_devices' on Instance uuid 90fb24a5-e12e-4192-b12a-17b95d6f5250 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.objects.base [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Object Instance<90fb24a5-e12e-4192-b12a-17b95d6f5250> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:52:20 user nova-compute[76442]:   <uuid>90fb24a5-e12e-4192-b12a-17b95d6f5250</uuid>
Nov 14 20:52:20 user nova-compute[76442]:   <name>instance-00000021</name>
Nov 14 20:52:20 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:52:20 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:52:20 user nova-compute[76442]:   <metadata>
Nov 14 20:52:20 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:52:20 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:52:20 user nova-compute[76442]:       <nova:name>tempest-TestShelveInstance-server-1397663843</nova:name>
Nov 14 20:52:20 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:52:18</nova:creationTime>
Nov 14 20:52:20 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:52:20 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:52:20 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:52:20 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:52:20 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:52:20 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:52:20 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:52:20 user nova-compute[76442]:       <nova:owner>
Nov 14 20:52:20 user nova-compute[76442]:         <nova:user uuid="5e32d699395a4756a1dc55d1450f0756">tempest-TestShelveInstance-371963907-project-member</nova:user>
Nov 14 20:52:20 user nova-compute[76442]:         <nova:project uuid="5d797c60374a422eadb9e36efbe39c69">tempest-TestShelveInstance-371963907</nova:project>
Nov 14 20:52:20 user nova-compute[76442]:       </nova:owner>
Nov 14 20:52:20 user nova-compute[76442]:       <nova:ports>
Nov 14 20:52:20 user nova-compute[76442]:         <nova:port uuid="7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad">
Nov 14 20:52:20 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 20:52:20 user nova-compute[76442]:         </nova:port>
Nov 14 20:52:20 user nova-compute[76442]:       </nova:ports>
Nov 14 20:52:20 user nova-compute[76442]:     </nova:instance>
Nov 14 20:52:20 user nova-compute[76442]:   </metadata>
Nov 14 20:52:20 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:52:20 user nova-compute[76442]:     <system>
Nov 14 20:52:20 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:52:20 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:52:20 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:52:20 user nova-compute[76442]:       <entry name="serial">90fb24a5-e12e-4192-b12a-17b95d6f5250</entry>
Nov 14 20:52:20 user nova-compute[76442]:       <entry name="uuid">90fb24a5-e12e-4192-b12a-17b95d6f5250</entry>
Nov 14 20:52:20 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:52:20 user nova-compute[76442]:     </system>
Nov 14 20:52:20 user nova-compute[76442]:   </sysinfo>
Nov 14 20:52:20 user nova-compute[76442]:   <os>
Nov 14 20:52:20 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:52:20 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:52:20 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:52:20 user nova-compute[76442]:   </os>
Nov 14 20:52:20 user nova-compute[76442]:   <features>
Nov 14 20:52:20 user nova-compute[76442]:     <acpi/>
Nov 14 20:52:20 user nova-compute[76442]:     <apic/>
Nov 14 20:52:20 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:52:20 user nova-compute[76442]:   </features>
Nov 14 20:52:20 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:52:20 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:52:20 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:52:20 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:52:20 user nova-compute[76442]:   </clock>
Nov 14 20:52:20 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:52:20 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:52:20 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:52:20 user nova-compute[76442]:   </cpu>
Nov 14 20:52:20 user nova-compute[76442]:   <devices>
Nov 14 20:52:20 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:52:20 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:52:20 user nova-compute[76442]:       <source dev="/dev/sdc"/>
Nov 14 20:52:20 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:52:20 user nova-compute[76442]:       <serial>aa18e9e6-8738-4939-a17e-b8f14cee1c88</serial>
Nov 14 20:52:20 user nova-compute[76442]:     </disk>
Nov 14 20:52:20 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:52:20 user nova-compute[76442]:       <mac address="fa:16:3e:bb:8b:5f"/>
Nov 14 20:52:20 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:52:20 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:52:20 user nova-compute[76442]:       <target dev="tap7b6a2b7a-dd"/>
Nov 14 20:52:20 user nova-compute[76442]:     </interface>
Nov 14 20:52:20 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:52:20 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/90fb24a5-e12e-4192-b12a-17b95d6f5250/console.log" append="off"/>
Nov 14 20:52:20 user nova-compute[76442]:     </serial>
Nov 14 20:52:20 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:52:20 user nova-compute[76442]:     <video>
Nov 14 20:52:20 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:52:20 user nova-compute[76442]:     </video>
Nov 14 20:52:20 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:52:20 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:52:20 user nova-compute[76442]:     </rng>
Nov 14 20:52:20 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:52:20 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:52:20 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:52:20 user nova-compute[76442]:     </memballoon>
Nov 14 20:52:20 user nova-compute[76442]:   </devices>
Nov 14 20:52:20 user nova-compute[76442]: </domain>
Nov 14 20:52:20 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397663843',display_name='tempest-TestShelveInstance-server-1397663843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397663843',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1392324859',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:48:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5d797c60374a422eadb9e36efbe39c69',ramdisk_id='',reservation_id='r-8m12x60y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-371963907',owner_user_name='tempest-TestShelveInstance-371963907-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:52:10Z,user_data=None,user_id='5e32d699395a4756a1dc55d1450f0756',uuid=90fb24a5-e12e-4192-b12a-17b95d6f5250,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converting VIF {"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG os_vif [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '135f2a60-5ef1-5443-82a5-ec4ebb0c32ce', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b6a2b7a-dd, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b6a2b7a-dd, col_values=(('qos', UUID('6337e391-f255-48f7-baa5-9b57bfaf353e')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b6a2b7a-dd, col_values=(('external_ids', {'iface-id': '7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:8b:5f', 'vm-uuid': '90fb24a5-e12e-4192-b12a-17b95d6f5250'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:20 user nova-compute[76442]: INFO os_vif [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd')
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:52:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] No VIF found with MAC fa:16:3e:bb:8b:5f, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:52:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updating instance_info_cache with network_info: [{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:52:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:52:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:52:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-87c8026d-8fc8-48e9-9ce2-644c5bc8d510 req-53dd4ee6-6879-4524-99ac-baa740914082 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-87c8026d-8fc8-48e9-9ce2-644c5bc8d510 req-53dd4ee6-6879-4524-99ac-baa740914082 service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-87c8026d-8fc8-48e9-9ce2-644c5bc8d510 req-53dd4ee6-6879-4524-99ac-baa740914082 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-87c8026d-8fc8-48e9-9ce2-644c5bc8d510 req-53dd4ee6-6879-4524-99ac-baa740914082 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-87c8026d-8fc8-48e9-9ce2-644c5bc8d510 req-53dd4ee6-6879-4524-99ac-baa740914082 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:22 user nova-compute[76442]: WARNING nova.compute.manager [req-87c8026d-8fc8-48e9-9ce2-644c5bc8d510 req-53dd4ee6-6879-4524-99ac-baa740914082 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 20:52:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:52:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:52:24 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance spawned successfully.
Nov 14 20:52:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:52:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f5a57c34-4af6-4103-bd53-9ad79264e43b tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.606s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-05486faa-493d-45ff-894a-6259e7b70de0 req-dadc6e37-9341-4724-9460-b8333feb9eac service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-05486faa-493d-45ff-894a-6259e7b70de0 req-dadc6e37-9341-4724-9460-b8333feb9eac service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-05486faa-493d-45ff-894a-6259e7b70de0 req-dadc6e37-9341-4724-9460-b8333feb9eac service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-05486faa-493d-45ff-894a-6259e7b70de0 req-dadc6e37-9341-4724-9460-b8333feb9eac service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:24 user nova-compute[76442]: DEBUG nova.compute.manager [req-05486faa-493d-45ff-894a-6259e7b70de0 req-dadc6e37-9341-4724-9460-b8333feb9eac service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:24 user nova-compute[76442]: WARNING nova.compute.manager [req-05486faa-493d-45ff-894a-6259e7b70de0 req-dadc6e37-9341-4724-9460-b8333feb9eac service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state active and task_state None.
Nov 14 20:52:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-bad14c59-20a5-42d9-ad2b-9b9f54f92955 req-2a1afdf7-b60b-43e2-b1f0-187e2a65f57e service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received event network-changed-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-bad14c59-20a5-42d9-ad2b-9b9f54f92955 req-2a1afdf7-b60b-43e2-b1f0-187e2a65f57e service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Refreshing instance network info cache due to event network-changed-c56baf3f-0124-4538-875e-34afb3117ce2. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:52:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bad14c59-20a5-42d9-ad2b-9b9f54f92955 req-2a1afdf7-b60b-43e2-b1f0-187e2a65f57e service nova] Acquiring lock "refresh_cache-e389a14f-286f-48d8-ae75-2b5bbadf3188" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:52:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bad14c59-20a5-42d9-ad2b-9b9f54f92955 req-2a1afdf7-b60b-43e2-b1f0-187e2a65f57e service nova] Acquired lock "refresh_cache-e389a14f-286f-48d8-ae75-2b5bbadf3188" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:52:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-bad14c59-20a5-42d9-ad2b-9b9f54f92955 req-2a1afdf7-b60b-43e2-b1f0-187e2a65f57e service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Refreshing network info cache for port c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:52:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-bad14c59-20a5-42d9-ad2b-9b9f54f92955 req-2a1afdf7-b60b-43e2-b1f0-187e2a65f57e service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Updated VIF entry in instance network info cache for port c56baf3f-0124-4538-875e-34afb3117ce2. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:52:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-bad14c59-20a5-42d9-ad2b-9b9f54f92955 req-2a1afdf7-b60b-43e2-b1f0-187e2a65f57e service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Updating instance_info_cache with network_info: [{"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bad14c59-20a5-42d9-ad2b-9b9f54f92955 req-2a1afdf7-b60b-43e2-b1f0-187e2a65f57e service nova] Releasing lock "refresh_cache-e389a14f-286f-48d8-ae75-2b5bbadf3188" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:52:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lazy-loading 'flavor' on Instance uuid e389a14f-286f-48d8-ae75-2b5bbadf3188 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:33 user nova-compute[76442]: INFO nova.compute.manager [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Attaching volume 603c1189-170d-487f-b25c-e4acdfa1fd64 to /dev/vdb
Nov 14 20:52:33 user nova-compute[76442]: DEBUG os_brick.utils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acf9948-c449-4c23-b7b2-ac535d882b24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f869c9-911c-4b79-98f6-786bfeaa77c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f377a7ff-6fcc-4a51-bcc2-453490d33cc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18775b6-eb21-4a85-9593-c3c88c02752f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:52:33 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:52:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[315c364d-528c-432f-aad8-3eca30c8e613]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG os_brick.utils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:52:33 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Updating existing volume attachment record: 5f9a48dd-1a69-480c-995d-543d577fcf97 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:52:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquiring lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquiring lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:36 user nova-compute[76442]: INFO nova.compute.manager [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Terminating instance
Nov 14 20:52:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-c0b02f6e-5ef9-4709-aea1-2cf482b79c06 req-acd24581-633a-44e8-a620-86df81ad8766 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received event network-vif-unplugged-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c0b02f6e-5ef9-4709-aea1-2cf482b79c06 req-acd24581-633a-44e8-a620-86df81ad8766 service nova] Acquiring lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c0b02f6e-5ef9-4709-aea1-2cf482b79c06 req-acd24581-633a-44e8-a620-86df81ad8766 service nova] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c0b02f6e-5ef9-4709-aea1-2cf482b79c06 req-acd24581-633a-44e8-a620-86df81ad8766 service nova] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-c0b02f6e-5ef9-4709-aea1-2cf482b79c06 req-acd24581-633a-44e8-a620-86df81ad8766 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] No waiting events found dispatching network-vif-unplugged-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-c0b02f6e-5ef9-4709-aea1-2cf482b79c06 req-acd24581-633a-44e8-a620-86df81ad8766 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received event network-vif-unplugged-0313297d-7f40-4085-ac93-12730209ec83 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:52:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Instance destroyed successfully.
Nov 14 20:52:37 user nova-compute[76442]: DEBUG nova.objects.instance [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lazy-loading 'resources' on Instance uuid c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2076349630',display_name='tempest-VolumesNegativeTest-instance-2076349630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2076349630',id=35,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63e31d496f7e42b48483ed48b31b8741',ramdisk_id='',reservation_id='r-ah8ac5xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-66198869',owner_user_name='tempest-VolumesNegativeTest-66198869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:50:53Z,user_data=None,user_id='3d8b17fc9c1c4a218ac825b1c1494e8a',uuid=c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Converting VIF {"id": "0313297d-7f40-4085-ac93-12730209ec83", "address": "fa:16:3e:bd:fa:db", "network": {"id": "509f48af-3056-44f2-a364-e7619473953b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e57cfad766224722a83729fdae4800c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0313297d-7f", "ovs_interfaceid": "0313297d-7f40-4085-ac93-12730209ec83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fa:db,bridge_name='br-int',has_traffic_filtering=True,id=0313297d-7f40-4085-ac93-12730209ec83,network=Network(509f48af-3056-44f2-a364-e7619473953b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0313297d-7f') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG os_vif [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fa:db,bridge_name='br-int',has_traffic_filtering=True,id=0313297d-7f40-4085-ac93-12730209ec83,network=Network(509f48af-3056-44f2-a364-e7619473953b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0313297d-7f') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0313297d-7f, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b72b4fbc-5547-4d33-b19d-d9838456d27e) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:37 user nova-compute[76442]: INFO os_vif [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:fa:db,bridge_name='br-int',has_traffic_filtering=True,id=0313297d-7f40-4085-ac93-12730209ec83,network=Network(509f48af-3056-44f2-a364-e7619473953b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0313297d-7f')
Nov 14 20:52:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Deleting instance files /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68_del
Nov 14 20:52:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Deletion of /opt/stack/data/nova/instances/c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68_del complete
Nov 14 20:52:37 user nova-compute[76442]: INFO nova.compute.manager [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 14 20:52:37 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:37 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Took 0.51 seconds to deallocate network for instance.
Nov 14 20:52:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-f113123e-3e90-4134-a415-036e6b65a4d4 req-0beea665-90b0-44fc-83e3-39873eb9c176 service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received event network-vif-deleted-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:38 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Deleted allocations for instance c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6a5f8331-5a8c-45c9-b6b5-dff1436c4eb0 tempest-VolumesNegativeTest-66198869 tempest-VolumesNegativeTest-66198869-project-member] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.816s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHvuKkZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:52:38 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:52:38 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:52:38 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b324716e-625e-4f61-8cde-d02067443b93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:52:38 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c688f0b-2ddb-4c87-aad8-b0cdf2ce03b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64] added
Nov 14 20:52:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e830d66-506a-4186-897e-77ba32bc9ac2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e037831-9c16-4573-be58-83562b6a688d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHvuKkZh {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHvuKkZh" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeab4fbc-99b2-4ba5-98b9-a3cea6d4f8d3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHvuKkZh'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31485a1-b1b9-408f-a6c5-1dd88e612032]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8406b5e7-7da7-4381-a494-2de1297f013d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2c80b1-405e-48f3-97a4-0347702637d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64, portal: 172.16.0.220,3260]
Nov 14 20:52:38 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64, portal: 172.16.0.220,3260] successful.
Nov 14 20:52:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c78580-e087-4da2-8e16-bdf8d4c2e934]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d742368-fa6a-469b-8685-4fc81867a2b2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 (non-flash)
Nov 14 20:52:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd858e9-8bc4-4e1e-bbee-de81da6c205a]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHvuKkZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-2cf14656-dcdc-47c3-9243-e459a00ed746 req-04fdb219-c679-4746-af22-765f6605d05a service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received event network-vif-plugged-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2cf14656-dcdc-47c3-9243-e459a00ed746 req-04fdb219-c679-4746-af22-765f6605d05a service nova] Acquiring lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2cf14656-dcdc-47c3-9243-e459a00ed746 req-04fdb219-c679-4746-af22-765f6605d05a service nova] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2cf14656-dcdc-47c3-9243-e459a00ed746 req-04fdb219-c679-4746-af22-765f6605d05a service nova] Lock "c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-2cf14656-dcdc-47c3-9243-e459a00ed746 req-04fdb219-c679-4746-af22-765f6605d05a service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] No waiting events found dispatching network-vif-plugged-0313297d-7f40-4085-ac93-12730209ec83 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:38 user nova-compute[76442]: WARNING nova.compute.manager [req-2cf14656-dcdc-47c3-9243-e459a00ed746 req-04fdb219-c679-4746-af22-765f6605d05a service nova] [instance: c7161bbc-2bfc-4ab2-9d24-b7aaa3eb1a68] Received unexpected event network-vif-plugged-0313297d-7f40-4085-ac93-12730209ec83 for instance with vm_state deleted and task_state None.
Nov 14 20:52:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:52:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23537326533393766', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:52:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537326533393766', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:52:39 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lazy-loading 'flavor' on Instance uuid e389a14f-286f-48d8-ae75-2b5bbadf3188 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:52:39 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:52:39 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:52:39 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:52:39 user nova-compute[76442]:   <serial>603c1189-170d-487f-b25c-e4acdfa1fd64</serial>
Nov 14 20:52:39 user nova-compute[76442]: </disk>
Nov 14 20:52:39 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:52:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:52:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:52:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] No VIF found with MAC fa:16:3e:c7:b6:21, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:52:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e4d0125d-ee21-4c31-b908-0fd4da7701ba tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.641s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:42 user nova-compute[76442]: INFO nova.compute.manager [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Detaching volume 603c1189-170d-487f-b25c-e4acdfa1fd64
Nov 14 20:52:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:42 user nova-compute[76442]: INFO nova.virt.block_device [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Attempting to driver detach volume 603c1189-170d-487f-b25c-e4acdfa1fd64 from mountpoint /dev/vdb
Nov 14 20:52:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Attempting to detach device vdb from instance e389a14f-286f-48d8-ae75-2b5bbadf3188 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:52:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:52:42 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:52:42 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:52:42 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:52:42 user nova-compute[76442]:   <serial>603c1189-170d-487f-b25c-e4acdfa1fd64</serial>
Nov 14 20:52:42 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:52:42 user nova-compute[76442]: </disk>
Nov 14 20:52:42 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:52:42 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Successfully detached device vdb from instance e389a14f-286f-48d8-ae75-2b5bbadf3188 from the persistent domain config.
Nov 14 20:52:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e389a14f-286f-48d8-ae75-2b5bbadf3188 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:52:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:52:42 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:52:42 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:52:42 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:52:42 user nova-compute[76442]:   <serial>603c1189-170d-487f-b25c-e4acdfa1fd64</serial>
Nov 14 20:52:42 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:52:42 user nova-compute[76442]: </disk>
Nov 14 20:52:42 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:52:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e389a14f-286f-48d8-ae75-2b5bbadf3188 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:52:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:49 user nova-compute[76442]: INFO nova.compute.manager [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Terminating instance
Nov 14 20:52:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6e7da1d-506a-4002-980b-2f325690c8e3 req-b10ea553-084c-4fff-bb0f-3ed464527ec4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-unplugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6e7da1d-506a-4002-980b-2f325690c8e3 req-b10ea553-084c-4fff-bb0f-3ed464527ec4 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6e7da1d-506a-4002-980b-2f325690c8e3 req-b10ea553-084c-4fff-bb0f-3ed464527ec4 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6e7da1d-506a-4002-980b-2f325690c8e3 req-b10ea553-084c-4fff-bb0f-3ed464527ec4 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6e7da1d-506a-4002-980b-2f325690c8e3 req-b10ea553-084c-4fff-bb0f-3ed464527ec4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-unplugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6e7da1d-506a-4002-980b-2f325690c8e3 req-b10ea553-084c-4fff-bb0f-3ed464527ec4 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-unplugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "88dd9488-e777-4b33-9702-e8f0353a62c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:49 user nova-compute[76442]: INFO nova.compute.manager [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Terminating instance
Nov 14 20:52:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-3d204b72-d084-49ab-8ec7-e9dfe9a92bbc req-9d9c5c7c-09ff-4c66-a8ec-3d42f245f35e service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received event network-vif-unplugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3d204b72-d084-49ab-8ec7-e9dfe9a92bbc req-9d9c5c7c-09ff-4c66-a8ec-3d42f245f35e service nova] Acquiring lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3d204b72-d084-49ab-8ec7-e9dfe9a92bbc req-9d9c5c7c-09ff-4c66-a8ec-3d42f245f35e service nova] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3d204b72-d084-49ab-8ec7-e9dfe9a92bbc req-9d9c5c7c-09ff-4c66-a8ec-3d42f245f35e service nova] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-3d204b72-d084-49ab-8ec7-e9dfe9a92bbc req-9d9c5c7c-09ff-4c66-a8ec-3d42f245f35e service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] No waiting events found dispatching network-vif-unplugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-3d204b72-d084-49ab-8ec7-e9dfe9a92bbc req-9d9c5c7c-09ff-4c66-a8ec-3d42f245f35e service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received event network-vif-unplugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Instance destroyed successfully.
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.objects.instance [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'resources' on Instance uuid a4a163ab-45ce-4db5-860c-61da5fe9b734 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:47:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2130661136',display_name='tempest-TestMinimumBasicScenario-server-2130661136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2130661136',id=31,image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFF+s/3VSD44gIlOirpYAcop6pTflhvSLdYoJMOJGvy3Rft7VgQfNPniWXQv57ySyOJq+6cHi724M/oBlIkiAq6OuRhTVWk3XsPmG2VNbyAHrdtq+ubZUOeC622l9KYIA==',key_name='tempest-TestMinimumBasicScenario-229484950',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dc5de9e6eaa43439c6d0b2b1c1dccf8',ramdisk_id='',reservation_id='r-3zp0ew5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c047c0aa-4f92-4919-901e-be40e83724bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1647137476',owner_user_name='tempest-TestMinimumBasicScenario-1647137476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:50:13Z,user_data=None,user_id='45d53bb1eb4f416fa202ada14ba5ca10',uuid=a4a163ab-45ce-4db5-860c-61da5fe9b734,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converting VIF {"id": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "address": "fa:16:3e:f7:fb:3f", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f6b501-0b", "ovs_interfaceid": "84f6b501-0b46-4c51-92da-2037bb8a1cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG os_vif [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84f6b501-0b, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:52:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Instance destroyed successfully.
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.objects.instance [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'resources' on Instance uuid 88dd9488-e777-4b33-9702-e8f0353a62c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47899bd5-1dd4-4c4e-8f18-78fd0da2a088) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:43:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469363056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469363056',id=25,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:43:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-z67mbit9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:45:23Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=88dd9488-e777-4b33-9702-e8f0353a62c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "address": "fa:16:3e:45:3c:e5", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd6ee6af-3c", "ovs_interfaceid": "fd6ee6af-3cd0-49a2-b152-25c356a674c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:3c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fd6ee6af-3cd0-49a2-b152-25c356a674c2,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd6ee6af-3c') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG os_vif [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fd6ee6af-3cd0-49a2-b152-25c356a674c2,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd6ee6af-3c') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd6ee6af-3c, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:50 user nova-compute[76442]: INFO os_vif [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:fb:3f,bridge_name='br-int',has_traffic_filtering=True,id=84f6b501-0b46-4c51-92da-2037bb8a1cf1,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f6b501-0b')
Nov 14 20:52:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Deleting instance files /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734_del
Nov 14 20:52:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Deletion of /opt/stack/data/nova/instances/a4a163ab-45ce-4db5-860c-61da5fe9b734_del complete
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2c6fd78-5ad9-4772-a139-77d69efa3ac8) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: INFO os_vif [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3c:e5,bridge_name='br-int',has_traffic_filtering=True,id=fd6ee6af-3cd0-49a2-b152-25c356a674c2,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd6ee6af-3c')
Nov 14 20:52:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Deleting instance files /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6_del
Nov 14 20:52:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Deletion of /opt/stack/data/nova/instances/88dd9488-e777-4b33-9702-e8f0353a62c6_del complete
Nov 14 20:52:50 user nova-compute[76442]: INFO nova.compute.manager [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 20:52:50 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:52:50 user nova-compute[76442]: INFO nova.compute.manager [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 20:52:50 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:52:51 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Took 0.54 seconds to deallocate network for instance.
Nov 14 20:52:51 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Took 0.54 seconds to deallocate network for instance.
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-0429872c-b0dd-450c-a427-9ea426c149d0 req-54c2cab2-a9eb-4629-a37c-ce58117f4e2f service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received event network-vif-deleted-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.354s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:51 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Deleted allocations for instance a4a163ab-45ce-4db5-860c-61da5fe9b734
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4233cf6f-75f7-4fe8-b2dc-9ae252e82d09 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:51 user nova-compute[76442]: WARNING nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state deleted and task_state None.
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:51 user nova-compute[76442]: WARNING nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state deleted and task_state None.
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:51 user nova-compute[76442]: WARNING nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state deleted and task_state None.
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-unplugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-unplugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:51 user nova-compute[76442]: WARNING nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-unplugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state deleted and task_state None.
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Acquiring lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] Lock "a4a163ab-45ce-4db5-860c-61da5fe9b734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] No waiting events found dispatching network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:51 user nova-compute[76442]: WARNING nova.compute.manager [req-cd02a757-eaa0-4fc1-881d-9ff556b5664a req-2fd196e4-a8a6-4e34-b7a2-4b7ff2b55242 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received unexpected event network-vif-plugged-84f6b501-0b46-4c51-92da-2037bb8a1cf1 for instance with vm_state deleted and task_state None.
Nov 14 20:52:52 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:52:52 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:52:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:52 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Deleted allocations for instance 88dd9488-e777-4b33-9702-e8f0353a62c6
Nov 14 20:52:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-598f0f51-8c40-4c0e-a20b-b4cb2ee308fb req-b2fe3fc6-b48e-4591-99a7-33690cc33f21 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received event network-vif-plugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-598f0f51-8c40-4c0e-a20b-b4cb2ee308fb req-b2fe3fc6-b48e-4591-99a7-33690cc33f21 service nova] Acquiring lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:52:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-598f0f51-8c40-4c0e-a20b-b4cb2ee308fb req-b2fe3fc6-b48e-4591-99a7-33690cc33f21 service nova] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:52:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-598f0f51-8c40-4c0e-a20b-b4cb2ee308fb req-b2fe3fc6-b48e-4591-99a7-33690cc33f21 service nova] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-598f0f51-8c40-4c0e-a20b-b4cb2ee308fb req-b2fe3fc6-b48e-4591-99a7-33690cc33f21 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] No waiting events found dispatching network-vif-plugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:52:52 user nova-compute[76442]: WARNING nova.compute.manager [req-598f0f51-8c40-4c0e-a20b-b4cb2ee308fb req-b2fe3fc6-b48e-4591-99a7-33690cc33f21 service nova] [instance: 88dd9488-e777-4b33-9702-e8f0353a62c6] Received unexpected event network-vif-plugged-fd6ee6af-3cd0-49a2-b152-25c356a674c2 for instance with vm_state deleted and task_state None.
Nov 14 20:52:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-598f0f51-8c40-4c0e-a20b-b4cb2ee308fb req-b2fe3fc6-b48e-4591-99a7-33690cc33f21 service nova] [instance: a4a163ab-45ce-4db5-860c-61da5fe9b734] Received event network-vif-deleted-84f6b501-0b46-4c51-92da-2037bb8a1cf1 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:52:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-60b055d9-1ad0-4338-8a34-4673823e97c3 tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "88dd9488-e777-4b33-9702-e8f0353a62c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.336s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:52:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:52:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 20:53:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:53:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:53:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:02 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e389a14f-286f-48d8-ae75-2b5bbadf3188 is timed out.
Nov 14 20:53:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Successfully detached device vdb from instance e389a14f-286f-48d8-ae75-2b5bbadf3188 from the live domain config.
Nov 14 20:53:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHvuKkZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:53:02 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd077178-13d2-4000-aae3-3bf81762ff27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:53:02 user nova-compute[76442]: No targets found.
Nov 14 20:53:02 user nova-compute[76442]: iSNS:
Nov 14 20:53:02 user nova-compute[76442]: No targets found.
Nov 14 20:53:02 user nova-compute[76442]: STATIC:
Nov 14 20:53:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64
Nov 14 20:53:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:53:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:53:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88
Nov 14 20:53:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:53:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:02 user nova-compute[76442]: FIRMWARE:
Nov 14 20:53:02 user nova-compute[76442]: No targets found.
Nov 14 20:53:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:53:02 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:53:02 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d772d68e-ea04-44e6-83d2-20b4ca4373c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a527d4f-5002-493e-9f24-06abd8f09c42]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:02 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:02 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:53:02 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:02 user nova-compute[76442]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 (non-flash)
Nov 14 20:53:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:02 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:02 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:53:02 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:02 user nova-compute[76442]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 (non-flash)
Nov 14 20:53:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4df6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f39f48c-9907-4b4f-be20-a3672098d701]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f101c0-8b85-45fc-a958-a224a2846c9d]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8171474a-3ddc-4653-9d3c-223e9c24e1bc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb2fa65-d71f-4e4a-8af7-c0d34d21a2bc]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f2e1b-fd87-4c62-a2a7-7fea769d323c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa3e559-fd77-4252-b33f-f8f6f21fc0b0]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64, portal: 172.16.0.220,3260]
Nov 14 20:53:02 user nova-compute[76442]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64, portal: 172.16.0.220,3260] successful.
Nov 14 20:53:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603c1189-170d-487f-b25c-e4acdfa1fd64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca3785c-7367-49a0-9b6d-61b0970656f6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] <== disconnect_volume: return (313ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:53:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:53:03 user nova-compute[76442]: DEBUG nova.objects.instance [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lazy-loading 'flavor' on Instance uuid e389a14f-286f-48d8-ae75-2b5bbadf3188 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:53:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3afe4d69-b68a-4565-bea1-8d7963c106f5 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.640s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:53:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:53:15 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=7655MB free_disk=25.05664825439453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5253f642-7c49-4c03-8d13-5105497b4f5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 16cd640b-de2b-488c-82d6-05c49cf526ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e389a14f-286f-48d8-ae75-2b5bbadf3188 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 211f5689-1c50-4638-a3e4-deeafc6013cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 90fb24a5-e12e-4192-b12a-17b95d6f5250 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-d2d7f998-3b24-4503-8880-da088f9e2a16 req-c3a1613a-a281-4df8-afd5-0d0594fce543 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received event network-changed-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-d2d7f998-3b24-4503-8880-da088f9e2a16 req-c3a1613a-a281-4df8-afd5-0d0594fce543 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Refreshing instance network info cache due to event network-changed-0b8cae45-a556-4485-b884-75f84893d0dd. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d2d7f998-3b24-4503-8880-da088f9e2a16 req-c3a1613a-a281-4df8-afd5-0d0594fce543 service nova] Acquiring lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d2d7f998-3b24-4503-8880-da088f9e2a16 req-c3a1613a-a281-4df8-afd5-0d0594fce543 service nova] Acquired lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:53:16 user nova-compute[76442]: DEBUG nova.network.neutron [req-d2d7f998-3b24-4503-8880-da088f9e2a16 req-c3a1613a-a281-4df8-afd5-0d0594fce543 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Refreshing network info cache for port 0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:53:17 user nova-compute[76442]: DEBUG nova.network.neutron [req-d2d7f998-3b24-4503-8880-da088f9e2a16 req-c3a1613a-a281-4df8-afd5-0d0594fce543 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updated VIF entry in instance network info cache for port 0b8cae45-a556-4485-b884-75f84893d0dd. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:53:17 user nova-compute[76442]: DEBUG nova.network.neutron [req-d2d7f998-3b24-4503-8880-da088f9e2a16 req-c3a1613a-a281-4df8-afd5-0d0594fce543 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updating instance_info_cache with network_info: [{"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d2d7f998-3b24-4503-8880-da088f9e2a16 req-c3a1613a-a281-4df8-afd5-0d0594fce543 service nova] Releasing lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Stashing vm_state: active {{(pid=76442) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:53:18 user nova-compute[76442]: INFO nova.compute.claims [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Claim successful on node user
Nov 14 20:53:18 user nova-compute[76442]: INFO nova.compute.resource_tracker [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating resource usage from migration da1d0635-2385-4038-afa3-d1a903e888d2
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-5661cdee-9290-490f-88b7-0f97cbb51776 req-9daf001a-0ed6-4bb4-8cba-25b4081d3df1 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-changed-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-5661cdee-9290-490f-88b7-0f97cbb51776 req-9daf001a-0ed6-4bb4-8cba-25b4081d3df1 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Refreshing instance network info cache due to event network-changed-4059beb2-3592-4674-998b-eebf79ea5939. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5661cdee-9290-490f-88b7-0f97cbb51776 req-9daf001a-0ed6-4bb4-8cba-25b4081d3df1 service nova] Acquiring lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5661cdee-9290-490f-88b7-0f97cbb51776 req-9daf001a-0ed6-4bb4-8cba-25b4081d3df1 service nova] Acquired lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-5661cdee-9290-490f-88b7-0f97cbb51776 req-9daf001a-0ed6-4bb4-8cba-25b4081d3df1 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Refreshing network info cache for port 4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.397s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:18 user nova-compute[76442]: INFO nova.compute.manager [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Migrating
Nov 14 20:53:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-5661cdee-9290-490f-88b7-0f97cbb51776 req-9daf001a-0ed6-4bb4-8cba-25b4081d3df1 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updated VIF entry in instance network info cache for port 4059beb2-3592-4674-998b-eebf79ea5939. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-5661cdee-9290-490f-88b7-0f97cbb51776 req-9daf001a-0ed6-4bb4-8cba-25b4081d3df1 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating instance_info_cache with network_info: [{"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5661cdee-9290-490f-88b7-0f97cbb51776 req-9daf001a-0ed6-4bb4-8cba-25b4081d3df1 service nova] Releasing lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquired lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:53:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG nova.network.neutron [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating instance_info_cache with network_info: [{"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Releasing lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Starting migrate_disk_and_power_off {{(pid=76442) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-5cba0d40-0810-4998-b5a9-fa047e2a2237 req-02949b98-60df-4433-877c-9e1cd141cee1 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-unplugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5cba0d40-0810-4998-b5a9-fa047e2a2237 req-02949b98-60df-4433-877c-9e1cd141cee1 service nova] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5cba0d40-0810-4998-b5a9-fa047e2a2237 req-02949b98-60df-4433-877c-9e1cd141cee1 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5cba0d40-0810-4998-b5a9-fa047e2a2237 req-02949b98-60df-4433-877c-9e1cd141cee1 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG nova.compute.manager [req-5cba0d40-0810-4998-b5a9-fa047e2a2237 req-02949b98-60df-4433-877c-9e1cd141cee1 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] No waiting events found dispatching network-vif-unplugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:19 user nova-compute[76442]: WARNING nova.compute.manager [req-5cba0d40-0810-4998-b5a9-fa047e2a2237 req-02949b98-60df-4433-877c-9e1cd141cee1 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received unexpected event network-vif-unplugged-4059beb2-3592-4674-998b-eebf79ea5939 for instance with vm_state active and task_state resize_migrating.
Nov 14 20:53:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Updating instance_info_cache with network_info: [{"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-f9200286-76da-4cc2-8592-c46cfbd5e83e" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:53:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:20 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Instance destroyed successfully.
Nov 14 20:53:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-152620928',display_name='tempest-ServerActionsTestOtherA-server-152620928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-152620928',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoMdApy2/8RPeA4MJeY2Nu8Fs1E5GIuT9rjXghW7E9nGEEJp3g35T0Y9hTYfuPiIewBxyfqXb2Q0ojDzSguW+OQkINVwKKH0JhOm94wxqmTbduWYc6NzfRIomyekkQ6+w==',key_name='tempest-keypair-553797527',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-npnxfbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=211f5689-1c50-4638-a3e4-deeafc6013cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-723030657-network", "vif_mac": "fa:16:3e:5f:c9:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-723030657-network", "vif_mac": "fa:16:3e:5f:c9:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_vif [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4059beb2-35, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1559e3ea-5b0a-4b77-9260-ea1de3900522) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:20 user nova-compute[76442]: INFO os_vif [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35')
Nov 14 20:53:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEHtinmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:53:20 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[551f0645-843e-4e96-b7fd-a48847417926]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:53:20 user nova-compute[76442]: No targets found.
Nov 14 20:53:20 user nova-compute[76442]: iSNS:
Nov 14 20:53:20 user nova-compute[76442]: No targets found.
Nov 14 20:53:20 user nova-compute[76442]: STATIC:
Nov 14 20:53:20 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:53:20 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:20 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:20 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:53:20 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:20 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:20 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88
Nov 14 20:53:20 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:20 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:20 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:53:20 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:20 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:20 user nova-compute[76442]: FIRMWARE:
Nov 14 20:53:20 user nova-compute[76442]: No targets found.
Nov 14 20:53:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:53:20 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:53:20 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dcd357-7e76-4573-bfe3-a172bcc81374]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ddb84a-e640-4a4b-8933-1fd993103bfd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:20 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:20 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:53:20 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:20 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:20 user nova-compute[76442]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:53:20 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e8793640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe'): ({'sdf'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Removing single pathed devices sdf {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[370135df-026c-46f2-b0e3-bc5fd7696882]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc26d37-4080-4b87-8f20-99451e1d9ae4]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flushing IO for device /dev/sdf {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac62ba36-1c28-449f-ad63-fcdef2aaddff]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[302bc789-41c3-4c26-9ed2-60a8b479ec7c]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3a4a8517',) {{(pid=87657) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ff54b5-5e03-4c54-b76e-b3200ac69d53]: (4, None) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1bad78-0b72-4adb-8690-8fa3c8d75173]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0f7117-2be8-4ea2-8165-750eab0fd4e8]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260]
Nov 14 20:53:20 user nova-compute[76442]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260] successful.
Nov 14 20:53:20 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9799f78-9b97-4a66-a10a-447e3a4b83b1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== disconnect_volume: return (297ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:53:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Port 4059beb2-3592-4674-998b-eebf79ea5939 binding to destination host user is already ACTIVE {{(pid=76442) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquired lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9d255b25-356a-4a66-a2f0-e4f5d853b8d8 req-e1167f79-6544-4bf0-b8db-c108d18962a6 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9d255b25-356a-4a66-a2f0-e4f5d853b8d8 req-e1167f79-6544-4bf0-b8db-c108d18962a6 service nova] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9d255b25-356a-4a66-a2f0-e4f5d853b8d8 req-e1167f79-6544-4bf0-b8db-c108d18962a6 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9d255b25-356a-4a66-a2f0-e4f5d853b8d8 req-e1167f79-6544-4bf0-b8db-c108d18962a6 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9d255b25-356a-4a66-a2f0-e4f5d853b8d8 req-e1167f79-6544-4bf0-b8db-c108d18962a6 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] No waiting events found dispatching network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:21 user nova-compute[76442]: WARNING nova.compute.manager [req-9d255b25-356a-4a66-a2f0-e4f5d853b8d8 req-e1167f79-6544-4bf0-b8db-c108d18962a6 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received unexpected event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 for instance with vm_state active and task_state resize_migrated.
Nov 14 20:53:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating instance_info_cache with network_info: [{"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Releasing lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG os_brick.utils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd9610b-c3f9-4a50-97cb-51c0413023a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3f2f67-4f12-4518-9153-eab80dee1376]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5647676-2495-4189-b32e-b56bd49bb2ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78c127e-9745-49f7-9306-7f7c9158ed3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:53:22 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:53:22 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5808b66-a058-41c2-91ce-9b1cb295f111]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:53:22 user nova-compute[76442]: DEBUG os_brick.utils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:53:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-5a24a563-9efa-4e50-975b-0c80178cecbf req-dae391e2-bded-45c8-8c48-eb1de2098b58 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received event network-changed-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-5a24a563-9efa-4e50-975b-0c80178cecbf req-dae391e2-bded-45c8-8c48-eb1de2098b58 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Refreshing instance network info cache due to event network-changed-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:53:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5a24a563-9efa-4e50-975b-0c80178cecbf req-dae391e2-bded-45c8-8c48-eb1de2098b58 service nova] Acquiring lock "refresh_cache-5ac92e77-71c5-4aa5-bc70-ca5227a15e59" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:53:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5a24a563-9efa-4e50-975b-0c80178cecbf req-dae391e2-bded-45c8-8c48-eb1de2098b58 service nova] Acquired lock "refresh_cache-5ac92e77-71c5-4aa5-bc70-ca5227a15e59" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:53:23 user nova-compute[76442]: DEBUG nova.network.neutron [req-5a24a563-9efa-4e50-975b-0c80178cecbf req-dae391e2-bded-45c8-8c48-eb1de2098b58 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Refreshing network info cache for port 93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:53:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:23 user nova-compute[76442]: DEBUG nova.objects.instance [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'flavor' on Instance uuid 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:53:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Ignoring supplied device name: /dev/vdb
Nov 14 20:53:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:24 user nova-compute[76442]: INFO nova.compute.manager [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Attaching volume 689209b5-c4b1-4c1d-afc5-c0eba20e0584 to /dev/vdb
Nov 14 20:53:24 user nova-compute[76442]: DEBUG os_brick.utils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fd947a-438f-4b7e-bdd2-ff3d25cd4d90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1981a03-2606-48ca-b442-66896cd8155f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1882358b-4f19-48f4-bebe-0a9934509764]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9f6cb8-3017-4a99-8dec-e3db75db61fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:53:24 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e2f7b-1fd8-47de-bdb9-73a479e8a4df]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG os_brick.utils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Updating existing volume attachment record: 595d18c3-a0f4-4368-8d41-c4f438dceab3 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG nova.network.neutron [req-5a24a563-9efa-4e50-975b-0c80178cecbf req-dae391e2-bded-45c8-8c48-eb1de2098b58 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Updated VIF entry in instance network info cache for port 93cc42aa-5a97-4ae7-aebb-bb1e8d90a081. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG nova.network.neutron [req-5a24a563-9efa-4e50-975b-0c80178cecbf req-dae391e2-bded-45c8-8c48-eb1de2098b58 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Updating instance_info_cache with network_info: [{"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5a24a563-9efa-4e50-975b-0c80178cecbf req-dae391e2-bded-45c8-8c48-eb1de2098b58 service nova] Releasing lock "refresh_cache-5ac92e77-71c5-4aa5-bc70-ca5227a15e59" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:53:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Starting finish_migration {{(pid=76442) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Instance directory exists: not creating {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 20:53:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Creating image(s)
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Ensure instance console log exists: /opt/stack/data/nova/instances/211f5689-1c50-4638-a3e4-deeafc6013cc/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Start _get_guest_xml network_info=[{"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-723030657-network", "vif_mac": "fa:16:3e:5f:c9:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEHtinmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '211f5689-1c50-4638-a3e4-deeafc6013cc', 'attached_at': '2023-11-14T20:53:31.000000', 'detached_at': '', 'volume_id': '6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'serial': '6a9edb99-0c95-417a-938d-8a2a0353d6fe'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '363e7d38-68b4-43c0-9805-e76e360ce2b2', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvXflTbg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:53:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:53:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:53:31 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:53:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEHtinmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:53:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a487923-164a-4af4-84db-9a8646e34ea2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:53:31 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a2b78e-d06e-4aa1-b583-289ae7457a5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584] added
Nov 14 20:53:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b4667a-bfd5-4f85-85c7-454c1958ed41]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a6067c-1868-49b7-867f-0085c060ef7e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvXflTbg {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvXflTbg" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8c3a8b-812e-42f1-bda2-d073cd5c2d4b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvXflTbg'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b538e8b-7d81-4fc1-a299-b2f083e36bd2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1f25c6-8f7f-49e1-89f5-f03cee73de41]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c059bc-f04a-49ae-af1e-06d9dd3a7274]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584, portal: 172.16.0.220,3260]
Nov 14 20:53:31 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584, portal: 172.16.0.220,3260] successful.
Nov 14 20:53:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3bb7ae-f704-48c9-89c7-6e79586a711c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3be057-9a9a-4b59-a2cb-d3c0fe32d8be]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:53:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[808082d2-4745-4a05-be61-d070cabd9750]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:53:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvXflTbg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23337623038303636', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337623038303636', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.295s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:53:32 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:53:32 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG nova.objects.instance [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'flavor' on Instance uuid 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa7f289-789a-41c2-ac8a-41b2615ba81d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:53:32 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:53:32 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:53:32 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:53:32 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:53:32 user nova-compute[76442]:   <serial>689209b5-c4b1-4c1d-afc5-c0eba20e0584</serial>
Nov 14 20:53:32 user nova-compute[76442]: </disk>
Nov 14 20:53:32 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d45175-e479-472d-b5c3-4b24d15f5764]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe] added
Nov 14 20:53:32 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[830cb464-22f2-4725-ac3e-99c6f3405536]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5aedc9-a714-4f60-b78d-44380ae73f93]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEHtinmL {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oEHtinmL" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d95765-f002-4809-a5d4-1c6d27016836]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oEHtinmL'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba840e0-1c43-4b3e-ae7c-5f8dad7528b2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd37479c-6b22-468f-808a-283d9c0b4efb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:32 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:32 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:32 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:53:32 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:32 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:32 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:32 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:53:32 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[924b9ae0-2758-428c-9328-6d3c3ff9cbf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260]
Nov 14 20:53:32 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260] successful.
Nov 14 20:53:32 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcd01d2-7263-47e3-9b1f-2c2466c971d2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[184c3aa6-f728-403b-8283-dbd1b573517b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:33 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:33 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:33 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:53:33 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:53:33 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:33 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:33 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:33 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:53:33 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:53:33 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b353e33-fb28-4e15-8173-164a7c14db7c]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEHtinmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No VIF found with MAC fa:16:3e:8e:9f:ca, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:53:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3f8a06ab-6755-459b-97bd-6cc168448cc2 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.268s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== connect_volume: return (2616ms) {'type': 'block', 'scsi_wwn': '26334663062346536', 'path': '/dev/sdf'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334663062346536', 'path': '/dev/sdf'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-152620928',display_name='tempest-ServerActionsTestOtherA-server-152620928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-152620928',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoMdApy2/8RPeA4MJeY2Nu8Fs1E5GIuT9rjXghW7E9nGEEJp3g35T0Y9hTYfuPiIewBxyfqXb2Q0ojDzSguW+OQkINVwKKH0JhOm94wxqmTbduWYc6NzfRIomyekkQ6+w==',key_name='tempest-keypair-553797527',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-npnxfbzv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=211f5689-1c50-4638-a3e4-deeafc6013cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-723030657-network", "vif_mac": "fa:16:3e:5f:c9:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-723030657-network", "vif_mac": "fa:16:3e:5f:c9:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:53:34 user nova-compute[76442]:   <uuid>211f5689-1c50-4638-a3e4-deeafc6013cc</uuid>
Nov 14 20:53:34 user nova-compute[76442]:   <name>instance-00000024</name>
Nov 14 20:53:34 user nova-compute[76442]:   <memory>2097152</memory>
Nov 14 20:53:34 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:53:34 user nova-compute[76442]:   <metadata>
Nov 14 20:53:34 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:53:34 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:53:34 user nova-compute[76442]:       <nova:name>tempest-ServerActionsTestOtherA-server-152620928</nova:name>
Nov 14 20:53:34 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:53:31</nova:creationTime>
Nov 14 20:53:34 user nova-compute[76442]:       <nova:flavor name="m1.small">
Nov 14 20:53:34 user nova-compute[76442]:         <nova:memory>2048</nova:memory>
Nov 14 20:53:34 user nova-compute[76442]:         <nova:disk>20</nova:disk>
Nov 14 20:53:34 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:53:34 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:53:34 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:53:34 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:53:34 user nova-compute[76442]:       <nova:owner>
Nov 14 20:53:34 user nova-compute[76442]:         <nova:user uuid="3b873835b5e341c5aebfd4ded5f2c093">tempest-ServerActionsTestOtherA-887472165-project-member</nova:user>
Nov 14 20:53:34 user nova-compute[76442]:         <nova:project uuid="265a9c8786db48c78145d1388a5c321f">tempest-ServerActionsTestOtherA-887472165</nova:project>
Nov 14 20:53:34 user nova-compute[76442]:       </nova:owner>
Nov 14 20:53:34 user nova-compute[76442]:       <nova:ports>
Nov 14 20:53:34 user nova-compute[76442]:         <nova:port uuid="4059beb2-3592-4674-998b-eebf79ea5939">
Nov 14 20:53:34 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 20:53:34 user nova-compute[76442]:         </nova:port>
Nov 14 20:53:34 user nova-compute[76442]:       </nova:ports>
Nov 14 20:53:34 user nova-compute[76442]:     </nova:instance>
Nov 14 20:53:34 user nova-compute[76442]:   </metadata>
Nov 14 20:53:34 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:53:34 user nova-compute[76442]:     <system>
Nov 14 20:53:34 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:53:34 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:53:34 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:53:34 user nova-compute[76442]:       <entry name="serial">211f5689-1c50-4638-a3e4-deeafc6013cc</entry>
Nov 14 20:53:34 user nova-compute[76442]:       <entry name="uuid">211f5689-1c50-4638-a3e4-deeafc6013cc</entry>
Nov 14 20:53:34 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:53:34 user nova-compute[76442]:     </system>
Nov 14 20:53:34 user nova-compute[76442]:   </sysinfo>
Nov 14 20:53:34 user nova-compute[76442]:   <os>
Nov 14 20:53:34 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:53:34 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:53:34 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:53:34 user nova-compute[76442]:   </os>
Nov 14 20:53:34 user nova-compute[76442]:   <features>
Nov 14 20:53:34 user nova-compute[76442]:     <acpi/>
Nov 14 20:53:34 user nova-compute[76442]:     <apic/>
Nov 14 20:53:34 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:53:34 user nova-compute[76442]:   </features>
Nov 14 20:53:34 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:53:34 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:53:34 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:53:34 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:53:34 user nova-compute[76442]:   </clock>
Nov 14 20:53:34 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:53:34 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:53:34 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:53:34 user nova-compute[76442]:   </cpu>
Nov 14 20:53:34 user nova-compute[76442]:   <devices>
Nov 14 20:53:34 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:53:34 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:53:34 user nova-compute[76442]:       <source dev="/dev/sdf"/>
Nov 14 20:53:34 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:53:34 user nova-compute[76442]:       <serial>6a9edb99-0c95-417a-938d-8a2a0353d6fe</serial>
Nov 14 20:53:34 user nova-compute[76442]:     </disk>
Nov 14 20:53:34 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:53:34 user nova-compute[76442]:       <mac address="fa:16:3e:5f:c9:a7"/>
Nov 14 20:53:34 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:53:34 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:53:34 user nova-compute[76442]:       <target dev="tap4059beb2-35"/>
Nov 14 20:53:34 user nova-compute[76442]:     </interface>
Nov 14 20:53:34 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:53:34 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/211f5689-1c50-4638-a3e4-deeafc6013cc/console.log" append="off"/>
Nov 14 20:53:34 user nova-compute[76442]:     </serial>
Nov 14 20:53:34 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:53:34 user nova-compute[76442]:     <video>
Nov 14 20:53:34 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:53:34 user nova-compute[76442]:     </video>
Nov 14 20:53:34 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:53:34 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:53:34 user nova-compute[76442]:     </rng>
Nov 14 20:53:34 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:53:34 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:53:34 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:53:34 user nova-compute[76442]:     </memballoon>
Nov 14 20:53:34 user nova-compute[76442]:   </devices>
Nov 14 20:53:34 user nova-compute[76442]: </domain>
Nov 14 20:53:34 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-152620928',display_name='tempest-ServerActionsTestOtherA-server-152620928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-152620928',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoMdApy2/8RPeA4MJeY2Nu8Fs1E5GIuT9rjXghW7E9nGEEJp3g35T0Y9hTYfuPiIewBxyfqXb2Q0ojDzSguW+OQkINVwKKH0JhOm94wxqmTbduWYc6NzfRIomyekkQ6+w==',key_name='tempest-keypair-553797527',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-npnxfbzv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=211f5689-1c50-4638-a3e4-deeafc6013cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-723030657-network", "vif_mac": "fa:16:3e:5f:c9:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-723030657-network", "vif_mac": "fa:16:3e:5f:c9:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG os_vif [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4d07d47-192d-546e-9d9c-a085a12593c9', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4059beb2-35, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4059beb2-35, col_values=(('qos', UUID('9f6d1023-e7e5-4bd9-b0a9-cb8e3148d130')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4059beb2-35, col_values=(('external_ids', {'iface-id': '4059beb2-3592-4674-998b-eebf79ea5939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:c9:a7', 'vm-uuid': '211f5689-1c50-4638-a3e4-deeafc6013cc'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: INFO os_vif [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35')
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] No VIF found with MAC fa:16:3e:5f:c9:a7, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:34 user nova-compute[76442]: INFO nova.compute.manager [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Terminating instance
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.compute.manager [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-33a79dc5-87ab-46da-9280-e39e1d3504a5 req-578c6f5f-24d6-4eae-8255-a1d4b9cc9855 service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received event network-vif-unplugged-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-33a79dc5-87ab-46da-9280-e39e1d3504a5 req-578c6f5f-24d6-4eae-8255-a1d4b9cc9855 service nova] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-33a79dc5-87ab-46da-9280-e39e1d3504a5 req-578c6f5f-24d6-4eae-8255-a1d4b9cc9855 service nova] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-33a79dc5-87ab-46da-9280-e39e1d3504a5 req-578c6f5f-24d6-4eae-8255-a1d4b9cc9855 service nova] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-33a79dc5-87ab-46da-9280-e39e1d3504a5 req-578c6f5f-24d6-4eae-8255-a1d4b9cc9855 service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] No waiting events found dispatching network-vif-unplugged-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-33a79dc5-87ab-46da-9280-e39e1d3504a5 req-578c6f5f-24d6-4eae-8255-a1d4b9cc9855 service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received event network-vif-unplugged-c56baf3f-0124-4538-875e-34afb3117ce2 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Instance destroyed successfully.
Nov 14 20:53:35 user nova-compute[76442]: DEBUG nova.objects.instance [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lazy-loading 'resources' on Instance uuid e389a14f-286f-48d8-ae75-2b5bbadf3188 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:50:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-989618307',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-989618307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9896183',id=34,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF58tJS0OweKqeBz/TghzDrl0qhkyzUtafRlzEi/Owr/989N62l8R8IHqc8atx7YpiEAhA8eujmpqLorqIIHP88B8nnUG/G1uWqyDQ/vlxye+E528TmQcIyQlail4pQebQ==',key_name='tempest-keypair-175244924',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:50:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38d1c0e3197b48a5aaed41f156c1e7f3',ramdisk_id='',reservation_id='r-cx7tr6k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1879144491',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d28e5b4a8944d8090af18d0002c3bac',uuid=e389a14f-286f-48d8-ae75-2b5bbadf3188,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Converting VIF {"id": "c56baf3f-0124-4538-875e-34afb3117ce2", "address": "fa:16:3e:c7:b6:21", "network": {"id": "09de3385-966a-46e7-b973-f4c2efc5bba5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-424751755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38d1c0e3197b48a5aaed41f156c1e7f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc56baf3f-01", "ovs_interfaceid": "c56baf3f-0124-4538-875e-34afb3117ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:21,bridge_name='br-int',has_traffic_filtering=True,id=c56baf3f-0124-4538-875e-34afb3117ce2,network=Network(09de3385-966a-46e7-b973-f4c2efc5bba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56baf3f-01') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG os_vif [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:21,bridge_name='br-int',has_traffic_filtering=True,id=c56baf3f-0124-4538-875e-34afb3117ce2,network=Network(09de3385-966a-46e7-b973-f4c2efc5bba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56baf3f-01') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc56baf3f-01, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cf21a1f-a685-447a-a8f4-53f0a6ffc298) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:35 user nova-compute[76442]: INFO os_vif [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:b6:21,bridge_name='br-int',has_traffic_filtering=True,id=c56baf3f-0124-4538-875e-34afb3117ce2,network=Network(09de3385-966a-46e7-b973-f4c2efc5bba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc56baf3f-01')
Nov 14 20:53:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Deleting instance files /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188_del
Nov 14 20:53:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Deletion of /opt/stack/data/nova/instances/e389a14f-286f-48d8-ae75-2b5bbadf3188_del complete
Nov 14 20:53:35 user nova-compute[76442]: INFO nova.compute.manager [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 20:53:35 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-45cb3473-e47e-4a74-9f0e-041c9824b3bb req-ae2343dc-9a3d-4b45-acf2-73fcc9d856a6 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-45cb3473-e47e-4a74-9f0e-041c9824b3bb req-ae2343dc-9a3d-4b45-acf2-73fcc9d856a6 service nova] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-45cb3473-e47e-4a74-9f0e-041c9824b3bb req-ae2343dc-9a3d-4b45-acf2-73fcc9d856a6 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-45cb3473-e47e-4a74-9f0e-041c9824b3bb req-ae2343dc-9a3d-4b45-acf2-73fcc9d856a6 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-45cb3473-e47e-4a74-9f0e-041c9824b3bb req-ae2343dc-9a3d-4b45-acf2-73fcc9d856a6 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] No waiting events found dispatching network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:35 user nova-compute[76442]: WARNING nova.compute.manager [req-45cb3473-e47e-4a74-9f0e-041c9824b3bb req-ae2343dc-9a3d-4b45-acf2-73fcc9d856a6 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received unexpected event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 for instance with vm_state active and task_state resize_finish.
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:36 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:36 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Took 0.83 seconds to deallocate network for instance.
Nov 14 20:53:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-6a5a619f-bd19-4046-9db7-25ecdf048730 req-778ae0ab-4bb4-4375-8243-bfa41ee4116d service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received event network-vif-plugged-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6a5a619f-bd19-4046-9db7-25ecdf048730 req-778ae0ab-4bb4-4375-8243-bfa41ee4116d service nova] Acquiring lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6a5a619f-bd19-4046-9db7-25ecdf048730 req-778ae0ab-4bb4-4375-8243-bfa41ee4116d service nova] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6a5a619f-bd19-4046-9db7-25ecdf048730 req-778ae0ab-4bb4-4375-8243-bfa41ee4116d service nova] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-6a5a619f-bd19-4046-9db7-25ecdf048730 req-778ae0ab-4bb4-4375-8243-bfa41ee4116d service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] No waiting events found dispatching network-vif-plugged-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:37 user nova-compute[76442]: WARNING nova.compute.manager [req-6a5a619f-bd19-4046-9db7-25ecdf048730 req-778ae0ab-4bb4-4375-8243-bfa41ee4116d service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received unexpected event network-vif-plugged-c56baf3f-0124-4538-875e-34afb3117ce2 for instance with vm_state deleted and task_state None.
Nov 14 20:53:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-6a5a619f-bd19-4046-9db7-25ecdf048730 req-778ae0ab-4bb4-4375-8243-bfa41ee4116d service nova] [instance: e389a14f-286f-48d8-ae75-2b5bbadf3188] Received event network-vif-deleted-c56baf3f-0124-4538-875e-34afb3117ce2 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:37 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Deleted allocations for instance e389a14f-286f-48d8-ae75-2b5bbadf3188
Nov 14 20:53:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-56416af8-1103-4c0f-8747-103da1fcbb1b tempest-TestServerVolumeAttachScenarioOldVersion-1879144491 tempest-TestServerVolumeAttachScenarioOldVersion-1879144491-project-member] Lock "e389a14f-286f-48d8-ae75-2b5bbadf3188" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.668s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:53:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Instance running successfully.
Nov 14 20:53:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Failed to set time: agent not configured {{(pid=76442) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 20:53:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b6a9b048-a314-4760-950f-d45943cfa190 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] finish_migration finished successfully. {{(pid=76442) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 20:53:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-0085a4de-97cf-49e2-8945-725dc72d858b req-27ee121a-9c0b-45e9-bd93-c1eb72ed526b service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0085a4de-97cf-49e2-8945-725dc72d858b req-27ee121a-9c0b-45e9-bd93-c1eb72ed526b service nova] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0085a4de-97cf-49e2-8945-725dc72d858b req-27ee121a-9c0b-45e9-bd93-c1eb72ed526b service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0085a4de-97cf-49e2-8945-725dc72d858b req-27ee121a-9c0b-45e9-bd93-c1eb72ed526b service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:38 user nova-compute[76442]: DEBUG nova.compute.manager [req-0085a4de-97cf-49e2-8945-725dc72d858b req-27ee121a-9c0b-45e9-bd93-c1eb72ed526b service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] No waiting events found dispatching network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:38 user nova-compute[76442]: WARNING nova.compute.manager [req-0085a4de-97cf-49e2-8945-725dc72d858b req-27ee121a-9c0b-45e9-bd93-c1eb72ed526b service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received unexpected event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 for instance with vm_state active and task_state resize_finish.
Nov 14 20:53:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:40 user nova-compute[76442]: INFO nova.compute.manager [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Terminating instance
Nov 14 20:53:40 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-890f8e26-fd04-486b-8d29-479bd5419e73 req-e04c3e88-701b-45dc-8259-354f60b0b2f0 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-unplugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-890f8e26-fd04-486b-8d29-479bd5419e73 req-e04c3e88-701b-45dc-8259-354f60b0b2f0 service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-890f8e26-fd04-486b-8d29-479bd5419e73 req-e04c3e88-701b-45dc-8259-354f60b0b2f0 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-890f8e26-fd04-486b-8d29-479bd5419e73 req-e04c3e88-701b-45dc-8259-354f60b0b2f0 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-890f8e26-fd04-486b-8d29-479bd5419e73 req-e04c3e88-701b-45dc-8259-354f60b0b2f0 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-unplugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-890f8e26-fd04-486b-8d29-479bd5419e73 req-e04c3e88-701b-45dc-8259-354f60b0b2f0 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-unplugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Instance destroyed successfully.
Nov 14 20:53:41 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'resources' on Instance uuid 5253f642-7c49-4c03-8d13-5105497b4f5d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-408016581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-408016581',id=13,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:39:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-gtus977f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:41:39Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=5253f642-7c49-4c03-8d13-5105497b4f5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "f58fa4af-61f7-4485-8d7d-96666813d45a", "address": "fa:16:3e:fa:28:05", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf58fa4af-61", "ovs_interfaceid": "f58fa4af-61f7-4485-8d7d-96666813d45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:28:05,bridge_name='br-int',has_traffic_filtering=True,id=f58fa4af-61f7-4485-8d7d-96666813d45a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58fa4af-61') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_vif [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:28:05,bridge_name='br-int',has_traffic_filtering=True,id=f58fa4af-61f7-4485-8d7d-96666813d45a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58fa4af-61') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf58fa4af-61, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e74cc66-25f0-42f7-8e1b-a6e5cae7b520) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:41 user nova-compute[76442]: INFO os_vif [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:28:05,bridge_name='br-int',has_traffic_filtering=True,id=f58fa4af-61f7-4485-8d7d-96666813d45a,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf58fa4af-61')
Nov 14 20:53:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLFkYdUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:53:41 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d0a118-c686-4a8a-847b-a04fd6b9c444]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:53:41 user nova-compute[76442]: No targets found.
Nov 14 20:53:41 user nova-compute[76442]: iSNS:
Nov 14 20:53:41 user nova-compute[76442]: No targets found.
Nov 14 20:53:41 user nova-compute[76442]: STATIC:
Nov 14 20:53:41 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:53:41 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:41 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:41 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6
Nov 14 20:53:41 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:41 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:41 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88
Nov 14 20:53:41 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:41 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:41 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:53:41 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:41 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:41 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584
Nov 14 20:53:41 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:53:41 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:53:41 user nova-compute[76442]: FIRMWARE:
Nov 14 20:53:41 user nova-compute[76442]: No targets found.
Nov 14 20:53:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:53:41 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:53:41 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[54df2920-8394-4bba-80af-b14a7b0bdae1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42ed19c-e948-44ad-80d3-c6d6483eb2b8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:41 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:41 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:41 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:53:41 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:53:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 (non-flash)
Nov 14 20:53:41 user nova-compute[76442]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:53:41 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:53:41 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:53:41 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:53:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4fedb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae8533c-16b9-4465-85ec-1591afbf7412]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[10186203-b771-4a1c-bad3-c5b5b7918fce]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d70657e-0ef3-4fe2-9d96-af6675363411]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7136778d-42c6-407f-8703-655d2a30b968]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b02938-6f8d-4808-adae-323c412dad76]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d48cb69-3e83-42c9-89fd-a2a2c82a32a2]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6, portal: 172.16.0.220,3260]
Nov 14 20:53:41 user nova-compute[76442]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6, portal: 172.16.0.220,3260] successful.
Nov 14 20:53:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f1e11e0-aaef-47a6-ac09-77d6960195d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff0628-b73f-4206-94df-c58126699b26]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] <== disconnect_volume: return (327ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:53:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Deleting instance files /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d_del
Nov 14 20:53:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Deletion of /opt/stack/data/nova/instances/5253f642-7c49-4c03-8d13-5105497b4f5d_del complete
Nov 14 20:53:41 user nova-compute[76442]: INFO nova.compute.manager [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 14 20:53:41 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:53:41 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:53:42 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:42 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Took 0.61 seconds to deallocate network for instance.
Nov 14 20:53:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-16c14185-6703-490f-a3ef-f4dcdfcb0d72 req-dfcc4170-694e-46b4-87e7-a7b11bfaf988 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-deleted-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:42 user nova-compute[76442]: INFO nova.compute.manager [req-16c14185-6703-490f-a3ef-f4dcdfcb0d72 req-dfcc4170-694e-46b4-87e7-a7b11bfaf988 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Neutron deleted interface f58fa4af-61f7-4485-8d7d-96666813d45a; detaching it from the instance and deleting it from the info cache
Nov 14 20:53:42 user nova-compute[76442]: DEBUG nova.network.neutron [req-16c14185-6703-490f-a3ef-f4dcdfcb0d72 req-dfcc4170-694e-46b4-87e7-a7b11bfaf988 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-16c14185-6703-490f-a3ef-f4dcdfcb0d72 req-dfcc4170-694e-46b4-87e7-a7b11bfaf988 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Detach interface failed, port_id=f58fa4af-61f7-4485-8d7d-96666813d45a, reason: Instance 5253f642-7c49-4c03-8d13-5105497b4f5d could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:53:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-24a89708-9e33-4b4e-adba-7c8dbe9cee14 req-7a6ddd4a-aaf6-42c0-a4f0-843e47276663 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24a89708-9e33-4b4e-adba-7c8dbe9cee14 req-7a6ddd4a-aaf6-42c0-a4f0-843e47276663 service nova] Acquiring lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24a89708-9e33-4b4e-adba-7c8dbe9cee14 req-7a6ddd4a-aaf6-42c0-a4f0-843e47276663 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-24a89708-9e33-4b4e-adba-7c8dbe9cee14 req-7a6ddd4a-aaf6-42c0-a4f0-843e47276663 service nova] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-24a89708-9e33-4b4e-adba-7c8dbe9cee14 req-7a6ddd4a-aaf6-42c0-a4f0-843e47276663 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] No waiting events found dispatching network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:42 user nova-compute[76442]: WARNING nova.compute.manager [req-24a89708-9e33-4b4e-adba-7c8dbe9cee14 req-7a6ddd4a-aaf6-42c0-a4f0-843e47276663 service nova] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Received unexpected event network-vif-plugged-f58fa4af-61f7-4485-8d7d-96666813d45a for instance with vm_state active and task_state deleting.
Nov 14 20:53:43 user nova-compute[76442]: INFO nova.compute.manager [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: 5253f642-7c49-4c03-8d13-5105497b4f5d] Took 0.85 seconds to detach 1 volumes for instance.
Nov 14 20:53:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:43 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:53:43 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:53:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:43 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Deleted allocations for instance 5253f642-7c49-4c03-8d13-5105497b4f5d
Nov 14 20:53:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9c21ba30-d6c6-49bc-91cd-96074f02edbc tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "5253f642-7c49-4c03-8d13-5105497b4f5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.365s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:43 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:53:44 user nova-compute[76442]: INFO nova.compute.claims [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Claim successful on node user
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:53:44 user nova-compute[76442]: INFO nova.compute.manager [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Detaching volume 689209b5-c4b1-4c1d-afc5-c0eba20e0584
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:53:44 user nova-compute[76442]: INFO nova.virt.block_device [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Attempting to driver detach volume 689209b5-c4b1-4c1d-afc5-c0eba20e0584 from mountpoint /dev/vdb
Nov 14 20:53:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Attempting to detach device vdb from instance 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:53:44 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:53:44 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:53:44 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:53:44 user nova-compute[76442]:   <serial>689209b5-c4b1-4c1d-afc5-c0eba20e0584</serial>
Nov 14 20:53:44 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:53:44 user nova-compute[76442]: </disk>
Nov 14 20:53:44 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:53:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Successfully detached device vdb from instance 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 from the persistent domain config.
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:53:44 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:53:44 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 20:53:44 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:53:44 user nova-compute[76442]:   <serial>689209b5-c4b1-4c1d-afc5-c0eba20e0584</serial>
Nov 14 20:53:44 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:53:44 user nova-compute[76442]: </disk>
Nov 14 20:53:44 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.policy [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45d53bb1eb4f416fa202ada14ba5ca10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc5de9e6eaa43439c6d0b2b1c1dccf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:53:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Creating image(s)
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "/opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "/opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "/opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "a14defe8e96f184ed36869f7a137f133862cdd03" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a14defe8e96f184ed36869f7a137f133862cdd03" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03.part --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG nova.virt.images [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] 940c224e-d601-4d29-b75a-9b9a9529d557 was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03.part /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Successfully created port: 0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03.part /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03.converted" returned: 0 in 0.215s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a14defe8e96f184ed36869f7a137f133862cdd03" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.168s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03 --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "a14defe8e96f184ed36869f7a137f133862cdd03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a14defe8e96f184ed36869f7a137f133862cdd03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03 --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03,backing_fmt=raw /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03,backing_fmt=raw /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk 1073741824" returned: 0 in 0.050s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "a14defe8e96f184ed36869f7a137f133862cdd03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03 --force-share --output=json" returned: 0 in 0.165s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Cannot resize image /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Ensure instance console log exists: /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Successfully updated port: 0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquired lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-49927e1c-1cab-4810-90c8-09281d784d9c req-58fbf4bc-b872-4ab9-9106-88165014599c service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-49927e1c-1cab-4810-90c8-09281d784d9c req-58fbf4bc-b872-4ab9-9106-88165014599c service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing instance network info cache due to event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-49927e1c-1cab-4810-90c8-09281d784d9c req-58fbf4bc-b872-4ab9-9106-88165014599c service nova] Acquiring lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:53:46 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.network.neutron [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating instance_info_cache with network_info: [{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Releasing lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Instance network_info: |[{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-49927e1c-1cab-4810-90c8-09281d784d9c req-58fbf4bc-b872-4ab9-9106-88165014599c service nova] Acquired lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-49927e1c-1cab-4810-90c8-09281d784d9c req-58fbf4bc-b872-4ab9-9106-88165014599c service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Start _get_guest_xml network_info=[{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:53:41Z,direct_url=<?>,disk_format='qcow2',id=940c224e-d601-4d29-b75a-9b9a9529d557,min_disk=0,min_ram=0,name='tempest-scenario-img--317639811',owner='3dc5de9e6eaa43439c6d0b2b1c1dccf8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:53:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '940c224e-d601-4d29-b75a-9b9a9529d557'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:53:47 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:53:47 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:53:41Z,direct_url=<?>,disk_format='qcow2',id=940c224e-d601-4d29-b75a-9b9a9529d557,min_disk=0,min_ram=0,name='tempest-scenario-img--317639811',owner='3dc5de9e6eaa43439c6d0b2b1c1dccf8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:53:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-224416208',display_name='tempest-TestMinimumBasicScenario-server-224416208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-224416208',id=38,image_ref='940c224e-d601-4d29-b75a-9b9a9529d557',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdsZGLepXUhypbgxgzv/Dl4G6z6bB3wMe8p/sPfAUKpwPz2iLr3ncrYImhpyfjKQBH35xmAQc3DoSQxroN98PVbmI+pDXBdyKRWjqh37WhnjiSDzwBv9+Cf1tqCmxm2+w==',key_name='tempest-TestMinimumBasicScenario-582632526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dc5de9e6eaa43439c6d0b2b1c1dccf8',ramdisk_id='',reservation_id='r-8ffdetfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='940c224e-d601-4d29-b75a-9b9a9529d557',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1647137476',owner_user_name='tempest-TestMinimumBasicScenario-1647137476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:53:45Z,user_data=None,user_id='45d53bb1eb4f416fa202ada14ba5ca10',uuid=f372cd49-b14f-49ae-9ffe-722822ae4ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converting VIF {"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:60:73,bridge_name='br-int',has_traffic_filtering=True,id=0356fbfc-6a6d-4f06-b191-f2dd7d056d86,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0356fbfc-6a') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'pci_devices' on Instance uuid f372cd49-b14f-49ae-9ffe-722822ae4ad9 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:53:47 user nova-compute[76442]:   <uuid>f372cd49-b14f-49ae-9ffe-722822ae4ad9</uuid>
Nov 14 20:53:47 user nova-compute[76442]:   <name>instance-00000026</name>
Nov 14 20:53:47 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:53:47 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:53:47 user nova-compute[76442]:   <metadata>
Nov 14 20:53:47 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:53:47 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:53:47 user nova-compute[76442]:       <nova:name>tempest-TestMinimumBasicScenario-server-224416208</nova:name>
Nov 14 20:53:47 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:53:47</nova:creationTime>
Nov 14 20:53:47 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:53:47 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:53:47 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:53:47 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:53:47 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:53:47 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:53:47 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:53:47 user nova-compute[76442]:       <nova:owner>
Nov 14 20:53:47 user nova-compute[76442]:         <nova:user uuid="45d53bb1eb4f416fa202ada14ba5ca10">tempest-TestMinimumBasicScenario-1647137476-project-member</nova:user>
Nov 14 20:53:47 user nova-compute[76442]:         <nova:project uuid="3dc5de9e6eaa43439c6d0b2b1c1dccf8">tempest-TestMinimumBasicScenario-1647137476</nova:project>
Nov 14 20:53:47 user nova-compute[76442]:       </nova:owner>
Nov 14 20:53:47 user nova-compute[76442]:       <nova:root type="image" uuid="940c224e-d601-4d29-b75a-9b9a9529d557"/>
Nov 14 20:53:47 user nova-compute[76442]:       <nova:ports>
Nov 14 20:53:47 user nova-compute[76442]:         <nova:port uuid="0356fbfc-6a6d-4f06-b191-f2dd7d056d86">
Nov 14 20:53:47 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 20:53:47 user nova-compute[76442]:         </nova:port>
Nov 14 20:53:47 user nova-compute[76442]:       </nova:ports>
Nov 14 20:53:47 user nova-compute[76442]:     </nova:instance>
Nov 14 20:53:47 user nova-compute[76442]:   </metadata>
Nov 14 20:53:47 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:53:47 user nova-compute[76442]:     <system>
Nov 14 20:53:47 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:53:47 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:53:47 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:53:47 user nova-compute[76442]:       <entry name="serial">f372cd49-b14f-49ae-9ffe-722822ae4ad9</entry>
Nov 14 20:53:47 user nova-compute[76442]:       <entry name="uuid">f372cd49-b14f-49ae-9ffe-722822ae4ad9</entry>
Nov 14 20:53:47 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:53:47 user nova-compute[76442]:     </system>
Nov 14 20:53:47 user nova-compute[76442]:   </sysinfo>
Nov 14 20:53:47 user nova-compute[76442]:   <os>
Nov 14 20:53:47 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:53:47 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:53:47 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:53:47 user nova-compute[76442]:   </os>
Nov 14 20:53:47 user nova-compute[76442]:   <features>
Nov 14 20:53:47 user nova-compute[76442]:     <acpi/>
Nov 14 20:53:47 user nova-compute[76442]:     <apic/>
Nov 14 20:53:47 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:53:47 user nova-compute[76442]:   </features>
Nov 14 20:53:47 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:53:47 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:53:47 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:53:47 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:53:47 user nova-compute[76442]:   </clock>
Nov 14 20:53:47 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:53:47 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:53:47 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:53:47 user nova-compute[76442]:   </cpu>
Nov 14 20:53:47 user nova-compute[76442]:   <devices>
Nov 14 20:53:47 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:53:47 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:53:47 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk"/>
Nov 14 20:53:47 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:53:47 user nova-compute[76442]:     </disk>
Nov 14 20:53:47 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:53:47 user nova-compute[76442]:       <mac address="fa:16:3e:93:60:73"/>
Nov 14 20:53:47 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:53:47 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:53:47 user nova-compute[76442]:       <target dev="tap0356fbfc-6a"/>
Nov 14 20:53:47 user nova-compute[76442]:     </interface>
Nov 14 20:53:47 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:53:47 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/console.log" append="off"/>
Nov 14 20:53:47 user nova-compute[76442]:     </serial>
Nov 14 20:53:47 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:53:47 user nova-compute[76442]:     <video>
Nov 14 20:53:47 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:53:47 user nova-compute[76442]:     </video>
Nov 14 20:53:47 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:53:47 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:53:47 user nova-compute[76442]:     </rng>
Nov 14 20:53:47 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:53:47 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:53:47 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:53:47 user nova-compute[76442]:     </memballoon>
Nov 14 20:53:47 user nova-compute[76442]:   </devices>
Nov 14 20:53:47 user nova-compute[76442]: </domain>
Nov 14 20:53:47 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-224416208',display_name='tempest-TestMinimumBasicScenario-server-224416208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-224416208',id=38,image_ref='940c224e-d601-4d29-b75a-9b9a9529d557',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdsZGLepXUhypbgxgzv/Dl4G6z6bB3wMe8p/sPfAUKpwPz2iLr3ncrYImhpyfjKQBH35xmAQc3DoSQxroN98PVbmI+pDXBdyKRWjqh37WhnjiSDzwBv9+Cf1tqCmxm2+w==',key_name='tempest-TestMinimumBasicScenario-582632526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dc5de9e6eaa43439c6d0b2b1c1dccf8',ramdisk_id='',reservation_id='r-8ffdetfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='940c224e-d601-4d29-b75a-9b9a9529d557',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1647137476',owner_user_name='tempest-TestMinimumBasicScenario-1647137476-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:53:45Z,user_data=None,user_id='45d53bb1eb4f416fa202ada14ba5ca10',uuid=f372cd49-b14f-49ae-9ffe-722822ae4ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converting VIF {"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:60:73,bridge_name='br-int',has_traffic_filtering=True,id=0356fbfc-6a6d-4f06-b191-f2dd7d056d86,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0356fbfc-6a') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG os_vif [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:60:73,bridge_name='br-int',has_traffic_filtering=True,id=0356fbfc-6a6d-4f06-b191-f2dd7d056d86,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0356fbfc-6a') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d7f02ad-f2d6-5299-a267-e30bb2a62cdc', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0356fbfc-6a, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0356fbfc-6a, col_values=(('qos', UUID('370f79ac-f310-4f62-88ab-507bb66648f7')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0356fbfc-6a, col_values=(('external_ids', {'iface-id': '0356fbfc-6a6d-4f06-b191-f2dd7d056d86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:60:73', 'vm-uuid': 'f372cd49-b14f-49ae-9ffe-722822ae4ad9'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:47 user nova-compute[76442]: INFO os_vif [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:60:73,bridge_name='br-int',has_traffic_filtering=True,id=0356fbfc-6a6d-4f06-b191-f2dd7d056d86,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0356fbfc-6a')
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No VIF found with MAC fa:16:3e:93:60:73, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-49927e1c-1cab-4810-90c8-09281d784d9c req-58fbf4bc-b872-4ab9-9106-88165014599c service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updated VIF entry in instance network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-49927e1c-1cab-4810-90c8-09281d784d9c req-58fbf4bc-b872-4ab9-9106-88165014599c service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating instance_info_cache with network_info: [{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:53:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-49927e1c-1cab-4810-90c8-09281d784d9c req-58fbf4bc-b872-4ab9-9106-88165014599c service nova] Releasing lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:53:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-98cfc542-96ca-4b8e-8b14-f0e7d27a4a85 req-15d07ac3-b863-4fac-9a50-26a0a9255d54 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-98cfc542-96ca-4b8e-8b14-f0e7d27a4a85 req-15d07ac3-b863-4fac-9a50-26a0a9255d54 service nova] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-98cfc542-96ca-4b8e-8b14-f0e7d27a4a85 req-15d07ac3-b863-4fac-9a50-26a0a9255d54 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-98cfc542-96ca-4b8e-8b14-f0e7d27a4a85 req-15d07ac3-b863-4fac-9a50-26a0a9255d54 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-98cfc542-96ca-4b8e-8b14-f0e7d27a4a85 req-15d07ac3-b863-4fac-9a50-26a0a9255d54 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] No waiting events found dispatching network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:49 user nova-compute[76442]: WARNING nova.compute.manager [req-98cfc542-96ca-4b8e-8b14-f0e7d27a4a85 req-15d07ac3-b863-4fac-9a50-26a0a9255d54 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received unexpected event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 for instance with vm_state building and task_state spawning.
Nov 14 20:53:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:53:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:53:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Instance spawned successfully.
Nov 14 20:53:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:53:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:53:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:53:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:53:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:53:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:53:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:53:51 user nova-compute[76442]: INFO nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 14 20:53:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:53:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-d334deb0-4ad0-4329-947e-a818fbb5b189 req-dfcd8654-88da-434b-9c3f-03e3f20dc072 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:53:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d334deb0-4ad0-4329-947e-a818fbb5b189 req-dfcd8654-88da-434b-9c3f-03e3f20dc072 service nova] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:53:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d334deb0-4ad0-4329-947e-a818fbb5b189 req-dfcd8654-88da-434b-9c3f-03e3f20dc072 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:53:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d334deb0-4ad0-4329-947e-a818fbb5b189 req-dfcd8654-88da-434b-9c3f-03e3f20dc072 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-d334deb0-4ad0-4329-947e-a818fbb5b189 req-dfcd8654-88da-434b-9c3f-03e3f20dc072 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] No waiting events found dispatching network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:53:51 user nova-compute[76442]: WARNING nova.compute.manager [req-d334deb0-4ad0-4329-947e-a818fbb5b189 req-dfcd8654-88da-434b-9c3f-03e3f20dc072 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received unexpected event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 for instance with vm_state building and task_state spawning.
Nov 14 20:53:51 user nova-compute[76442]: INFO nova.compute.manager [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Took 7.19 seconds to build instance.
Nov 14 20:53:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e8ea9578-1c96-47cc-b69c-86891a2aea19 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.323s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:53:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:53:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-863f5eee-8989-41fa-881e-3af37c4c5719 req-3d033e10-075f-4b9f-ae69-d933d2ab1cfa service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-863f5eee-8989-41fa-881e-3af37c4c5719 req-3d033e10-075f-4b9f-ae69-d933d2ab1cfa service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing instance network info cache due to event network-changed-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-863f5eee-8989-41fa-881e-3af37c4c5719 req-3d033e10-075f-4b9f-ae69-d933d2ab1cfa service nova] Acquiring lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-863f5eee-8989-41fa-881e-3af37c4c5719 req-3d033e10-075f-4b9f-ae69-d933d2ab1cfa service nova] Acquired lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG nova.network.neutron [req-863f5eee-8989-41fa-881e-3af37c4c5719 req-3d033e10-075f-4b9f-ae69-d933d2ab1cfa service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Refreshing network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:00 user nova-compute[76442]: INFO nova.compute.manager [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Terminating instance
Nov 14 20:54:00 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-517e3693-d3ca-496f-a251-f1de88979fe8 req-6bc27862-d6db-44cb-9c75-a6648450e876 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-unplugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-517e3693-d3ca-496f-a251-f1de88979fe8 req-6bc27862-d6db-44cb-9c75-a6648450e876 service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-517e3693-d3ca-496f-a251-f1de88979fe8 req-6bc27862-d6db-44cb-9c75-a6648450e876 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-517e3693-d3ca-496f-a251-f1de88979fe8 req-6bc27862-d6db-44cb-9c75-a6648450e876 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-517e3693-d3ca-496f-a251-f1de88979fe8 req-6bc27862-d6db-44cb-9c75-a6648450e876 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-unplugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-517e3693-d3ca-496f-a251-f1de88979fe8 req-6bc27862-d6db-44cb-9c75-a6648450e876 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-unplugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Instance destroyed successfully.
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.objects.instance [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lazy-loading 'resources' on Instance uuid 90fb24a5-e12e-4192-b12a-17b95d6f5250 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1397663843',display_name='tempest-TestShelveInstance-server-1397663843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1397663843',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx67k1DDPkBdKiI3IbJAC1rHUUU1hvj9H2/3jxRrPH3KPX8Zazo8oOw6NCL9quWEjhLhomjnfyfczp4TnImA5DB7QwzhGoc55zWkGQo86KPclAZssCuejQOGlibcoHz6A==',key_name='tempest-TestShelveInstance-1392324859',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:52:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d797c60374a422eadb9e36efbe39c69',ramdisk_id='',reservation_id='r-8m12x60y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-371963907',owner_user_name='tempest-TestShelveInstance-371963907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:52:24Z,user_data=None,user_id='5e32d699395a4756a1dc55d1450f0756',uuid=90fb24a5-e12e-4192-b12a-17b95d6f5250,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converting VIF {"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_vif [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b6a2b7a-dd, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6337e391-f255-48f7-baa5-9b57bfaf353e) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: INFO os_vif [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:8b:5f,bridge_name='br-int',has_traffic_filtering=True,id=7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad,network=Network(a61dfc73-798f-4bfa-82a3-c000900f431f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6a2b7a-dd')
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkqjRMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:54:01 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.network.neutron [req-863f5eee-8989-41fa-881e-3af37c4c5719 req-3d033e10-075f-4b9f-ae69-d933d2ab1cfa service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updated VIF entry in instance network info cache for port 7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG nova.network.neutron [req-863f5eee-8989-41fa-881e-3af37c4c5719 req-3d033e10-075f-4b9f-ae69-d933d2ab1cfa service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating instance_info_cache with network_info: [{"id": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "address": "fa:16:3e:bb:8b:5f", "network": {"id": "a61dfc73-798f-4bfa-82a3-c000900f431f", "bridge": "br-int", "label": "tempest-TestShelveInstance-585911708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d797c60374a422eadb9e36efbe39c69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6a2b7a-dd", "ovs_interfaceid": "7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e5b559-cd8f-4985-a1d3-fb97a6e3f4e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:54:01 user nova-compute[76442]: No targets found.
Nov 14 20:54:01 user nova-compute[76442]: iSNS:
Nov 14 20:54:01 user nova-compute[76442]: No targets found.
Nov 14 20:54:01 user nova-compute[76442]: STATIC:
Nov 14 20:54:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:54:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88
Nov 14 20:54:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:54:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:01 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584
Nov 14 20:54:01 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:01 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:01 user nova-compute[76442]: FIRMWARE:
Nov 14 20:54:01 user nova-compute[76442]: No targets found.
Nov 14 20:54:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:54:01 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:54:01 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-863f5eee-8989-41fa-881e-3af37c4c5719 req-3d033e10-075f-4b9f-ae69-d933d2ab1cfa service nova] Releasing lock "refresh_cache-90fb24a5-e12e-4192-b12a-17b95d6f5250" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa0a10-b1da-43d6-8e9a-56bb238b633c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd771bd-c6a0-4425-b9d5-74dec0db744f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:54:01 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:54:01 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:54:01 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:54:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:54:01 user nova-compute[76442]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 (non-flash)
Nov 14 20:54:01 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:54:01 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:54:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e848be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e16ab4a-7f71-4c4a-9f08-bcd49dd298b2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af68235-ea97-4bab-8185-1539dcca82b1]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bd4e11-3746-4013-a587-8fabcb0ccfd8]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be0e232-47e8-453a-858c-6a5b873066a3]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23136656430303335', '/dev/disk/by-id/scsi-1SCST_BIOad927db0-16ed003538f93262', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ad927db0') {{(pid=87657) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae33c6-c8ac-4995-8970-4de70466d589]: (4, None) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cdea20-eac3-4632-8483-65d430d608ea]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2849af07-bd2d-4c74-94a1-044244cb91d7]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260]
Nov 14 20:54:01 user nova-compute[76442]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88, portal: 172.16.0.220,3260] successful.
Nov 14 20:54:01 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:54:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa18e9e6-8738-4939-a17e-b8f14cee1c88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d7982-a632-4230-aeda-c2baf0a1995d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] <== disconnect_volume: return (384ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:54:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Deleting instance files /opt/stack/data/nova/instances/90fb24a5-e12e-4192-b12a-17b95d6f5250_del
Nov 14 20:54:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Deletion of /opt/stack/data/nova/instances/90fb24a5-e12e-4192-b12a-17b95d6f5250_del complete
Nov 14 20:54:02 user nova-compute[76442]: INFO nova.compute.manager [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 14 20:54:02 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:02 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:02 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Took 0.66 seconds to deallocate network for instance.
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:03 user nova-compute[76442]: WARNING nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state active and task_state deleting.
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:03 user nova-compute[76442]: WARNING nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state active and task_state deleting.
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:03 user nova-compute[76442]: WARNING nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state active and task_state deleting.
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-unplugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-unplugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-unplugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Acquiring lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] No waiting events found dispatching network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:03 user nova-compute[76442]: WARNING nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received unexpected event network-vif-plugged-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad for instance with vm_state active and task_state deleting.
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-e3024a0c-0d0d-4f69-b9c7-a24fed9b64d1 req-c2568df5-8a76-4ea6-acd7-854384819773 service nova] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Received event network-vif-deleted-7b6a2b7a-dd3a-4007-81b5-d6c08e5803ad {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:03 user nova-compute[76442]: INFO nova.compute.manager [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 20:54:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] [instance: 90fb24a5-e12e-4192-b12a-17b95d6f5250] Deleting volume: aa18e9e6-8738-4939-a17e-b8f14cee1c88 {{(pid=76442) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:04 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:54:04 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:54:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:04 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Deleted allocations for instance 90fb24a5-e12e-4192-b12a-17b95d6f5250
Nov 14 20:54:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00cc6d50-e750-4e7c-97a3-9f1400507327 tempest-TestShelveInstance-371963907 tempest-TestShelveInstance-371963907-project-member] Lock "90fb24a5-e12e-4192-b12a-17b95d6f5250" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.422s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-0e4fae75-0d1f-43f6-a820-2e8b36ca7201 req-3cab03eb-0aa5-4ea5-b8a6-14171c162bfb service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-changed-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-0e4fae75-0d1f-43f6-a820-2e8b36ca7201 req-3cab03eb-0aa5-4ea5-b8a6-14171c162bfb service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Refreshing instance network info cache due to event network-changed-ea269041-ffaf-4db5-93cf-170276a43527. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e4fae75-0d1f-43f6-a820-2e8b36ca7201 req-3cab03eb-0aa5-4ea5-b8a6-14171c162bfb service nova] Acquiring lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e4fae75-0d1f-43f6-a820-2e8b36ca7201 req-3cab03eb-0aa5-4ea5-b8a6-14171c162bfb service nova] Acquired lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-0e4fae75-0d1f-43f6-a820-2e8b36ca7201 req-3cab03eb-0aa5-4ea5-b8a6-14171c162bfb service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Refreshing network info cache for port ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:54:05 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 is timed out.
Nov 14 20:54:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Successfully detached device vdb from instance 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 from the live domain config.
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvXflTbg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:54:05 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a0465c-cc89-43fa-a371-0366afa7e873]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:54:05 user nova-compute[76442]: No targets found.
Nov 14 20:54:05 user nova-compute[76442]: iSNS:
Nov 14 20:54:05 user nova-compute[76442]: No targets found.
Nov 14 20:54:05 user nova-compute[76442]: STATIC:
Nov 14 20:54:05 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:54:05 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:05 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:05 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:54:05 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:05 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:05 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584
Nov 14 20:54:05 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:05 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:05 user nova-compute[76442]: FIRMWARE:
Nov 14 20:54:05 user nova-compute[76442]: No targets found.
Nov 14 20:54:05 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:54:05 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:54:05 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[13793470-c6e3-47fa-a8c3-e12850829400]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0188ed53-5a63-43a3-9782-35f96806ac08]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:54:05 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:54:05 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:54:05 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:54:05 user nova-compute[76442]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 (non-flash)
Nov 14 20:54:05 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:54:05 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4d79a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab06070d-f72d-4720-853f-7077354f852a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cada4e-8688-44cf-ac68-c8aa182ecd99]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc43fa8-a992-43b5-974e-aceaa97d6640]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf24df0-2d43-4868-9ce1-f4473158897a]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[686e476b-e66e-4b37-887a-7fce239af824]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-0e4fae75-0d1f-43f6-a820-2e8b36ca7201 req-3cab03eb-0aa5-4ea5-b8a6-14171c162bfb service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updated VIF entry in instance network info cache for port ea269041-ffaf-4db5-93cf-170276a43527. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-0e4fae75-0d1f-43f6-a820-2e8b36ca7201 req-3cab03eb-0aa5-4ea5-b8a6-14171c162bfb service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updating instance_info_cache with network_info: [{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e4fae75-0d1f-43f6-a820-2e8b36ca7201 req-3cab03eb-0aa5-4ea5-b8a6-14171c162bfb service nova] Releasing lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[faca8e69-4f86-45f2-89b6-bc813a89b9f6]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584, portal: 172.16.0.220,3260]
Nov 14 20:54:05 user nova-compute[76442]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584, portal: 172.16.0.220,3260] successful.
Nov 14 20:54:05 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:05 user nova-compute[76442]: INFO nova.compute.manager [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Detaching volume e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[223a53ce-51f1-4123-8bfa-1a1e1bdd42d5]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] <== disconnect_volume: return (319ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:54:05 user nova-compute[76442]: INFO nova.virt.block_device [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Attempting to driver detach volume e675f057-9fc6-47ee-9a10-c60d05e72b09 from mountpoint /dev/vdb
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Attempting to detach device vdb from instance 16cd640b-de2b-488c-82d6-05c49cf526ef from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:54:05 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:54:05 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:54:05 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:54:05 user nova-compute[76442]:   <serial>e675f057-9fc6-47ee-9a10-c60d05e72b09</serial>
Nov 14 20:54:05 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:54:05 user nova-compute[76442]: </disk>
Nov 14 20:54:05 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:54:05 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Successfully detached device vdb from instance 16cd640b-de2b-488c-82d6-05c49cf526ef from the persistent domain config.
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16cd640b-de2b-488c-82d6-05c49cf526ef from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:54:05 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:54:05 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:54:05 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:54:05 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:54:05 user nova-compute[76442]:   <serial>e675f057-9fc6-47ee-9a10-c60d05e72b09</serial>
Nov 14 20:54:05 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:54:05 user nova-compute[76442]: </disk>
Nov 14 20:54:05 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'flavor' on Instance uuid 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-50dea997-cc14-40bd-9958-c5991e5d4c21 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.914s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.782s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:06 user nova-compute[76442]: INFO nova.compute.manager [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Terminating instance
Nov 14 20:54:06 user nova-compute[76442]: DEBUG nova.compute.manager [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-3a4756eb-9d8e-4273-89e9-e7eec5d5fa44 req-d82057a8-2415-408c-9e84-407649efdddf service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received event network-vif-unplugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3a4756eb-9d8e-4273-89e9-e7eec5d5fa44 req-d82057a8-2415-408c-9e84-407649efdddf service nova] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3a4756eb-9d8e-4273-89e9-e7eec5d5fa44 req-d82057a8-2415-408c-9e84-407649efdddf service nova] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3a4756eb-9d8e-4273-89e9-e7eec5d5fa44 req-d82057a8-2415-408c-9e84-407649efdddf service nova] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-3a4756eb-9d8e-4273-89e9-e7eec5d5fa44 req-d82057a8-2415-408c-9e84-407649efdddf service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] No waiting events found dispatching network-vif-unplugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-3a4756eb-9d8e-4273-89e9-e7eec5d5fa44 req-d82057a8-2415-408c-9e84-407649efdddf service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received event network-vif-unplugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:54:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:07 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Instance destroyed successfully.
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.objects.instance [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'resources' on Instance uuid 5ac92e77-71c5-4aa5-bc70-ca5227a15e59 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1893255286',display_name='tempest-VolumesSnapshotTestJSON-instance-1893255286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1893255286',id=37,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiOZd4Jgj12km6KKHSY9D2iS+V+oaT3dZhRTFkGuK5Ce94NSr3V3ltDAlK1B1eWEIHPthBpOIqkGbT8INE24VKBo7h6SQlNgS57b6bDxs25wydyYN3WdJSxI51rfnV9CQ==',key_name='tempest-keypair-243117362',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:51:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23ecfb771a114113bdcdf1881fcb5f62',ramdisk_id='',reservation_id='r-w62bsmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1708796007',owner_user_name='tempest-VolumesSnapshotTestJSON-1708796007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:51:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d972568e27ee4a838e978c8d220699f0',uuid=5ac92e77-71c5-4aa5-bc70-ca5227a15e59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converting VIF {"id": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "address": "fa:16:3e:8e:9f:ca", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cc42aa-5a", "ovs_interfaceid": "93cc42aa-5a97-4ae7-aebb-bb1e8d90a081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:9f:ca,bridge_name='br-int',has_traffic_filtering=True,id=93cc42aa-5a97-4ae7-aebb-bb1e8d90a081,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cc42aa-5a') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_vif [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:9f:ca,bridge_name='br-int',has_traffic_filtering=True,id=93cc42aa-5a97-4ae7-aebb-bb1e8d90a081,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cc42aa-5a') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93cc42aa-5a, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5384db7f-d304-4b0b-8115-3ecbb519fd22) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:54:07 user nova-compute[76442]: INFO os_vif [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:9f:ca,bridge_name='br-int',has_traffic_filtering=True,id=93cc42aa-5a97-4ae7-aebb-bb1e8d90a081,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cc42aa-5a')
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvXflTbg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:54:07 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-6f9f24a2-b540-4ea7-88ff-7ba6d375ff51 req-f3e7e27d-33db-4f79-9d2a-dfad008c2aa1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-changed-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-6f9f24a2-b540-4ea7-88ff-7ba6d375ff51 req-f3e7e27d-33db-4f79-9d2a-dfad008c2aa1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Refreshing instance network info cache due to event network-changed-ea269041-ffaf-4db5-93cf-170276a43527. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6f9f24a2-b540-4ea7-88ff-7ba6d375ff51 req-f3e7e27d-33db-4f79-9d2a-dfad008c2aa1 service nova] Acquiring lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6f9f24a2-b540-4ea7-88ff-7ba6d375ff51 req-f3e7e27d-33db-4f79-9d2a-dfad008c2aa1 service nova] Acquired lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.network.neutron [req-6f9f24a2-b540-4ea7-88ff-7ba6d375ff51 req-f3e7e27d-33db-4f79-9d2a-dfad008c2aa1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Refreshing network info cache for port ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d72ea0-5cb5-49ca-adc6-8379b67525e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:54:07 user nova-compute[76442]: No targets found.
Nov 14 20:54:07 user nova-compute[76442]: iSNS:
Nov 14 20:54:07 user nova-compute[76442]: No targets found.
Nov 14 20:54:07 user nova-compute[76442]: STATIC:
Nov 14 20:54:07 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:54:07 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:07 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:07 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:54:07 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:07 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:07 user nova-compute[76442]: FIRMWARE:
Nov 14 20:54:07 user nova-compute[76442]: No targets found.
Nov 14 20:54:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:54:07 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:54:07 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689209b5-c4b1-4c1d-afc5-c0eba20e0584', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee5c244-3f64-454c-b54c-2f9571960bba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c591cf1-784c-457f-8e48-86516ddb3bfb]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:54:07 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:54:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:54:07 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:54:07 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07081cedd0>, {}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Disconnecting from: [] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] <== disconnect_volume: return (66ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:54:07 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Deleting instance files /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59_del
Nov 14 20:54:07 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Deletion of /opt/stack/data/nova/instances/5ac92e77-71c5-4aa5-bc70-ca5227a15e59_del complete
Nov 14 20:54:07 user nova-compute[76442]: INFO nova.compute.manager [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.network.neutron [req-6f9f24a2-b540-4ea7-88ff-7ba6d375ff51 req-f3e7e27d-33db-4f79-9d2a-dfad008c2aa1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updated VIF entry in instance network info cache for port ea269041-ffaf-4db5-93cf-170276a43527. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.network.neutron [req-6f9f24a2-b540-4ea7-88ff-7ba6d375ff51 req-f3e7e27d-33db-4f79-9d2a-dfad008c2aa1 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updating instance_info_cache with network_info: [{"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6f9f24a2-b540-4ea7-88ff-7ba6d375ff51 req-f3e7e27d-33db-4f79-9d2a-dfad008c2aa1 service nova] Releasing lock "refresh_cache-16cd640b-de2b-488c-82d6-05c49cf526ef" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:54:07 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:08 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Took 0.75 seconds to deallocate network for instance.
Nov 14 20:54:08 user nova-compute[76442]: WARNING nova.volume.cinder [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Attachment 595d18c3-a0f4-4368-8d41-c4f438dceab3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 595d18c3-a0f4-4368-8d41-c4f438dceab3. (HTTP 404) (Request-ID: req-82dc5038-30ab-4e34-96ea-1d80be992d43)
Nov 14 20:54:08 user nova-compute[76442]: INFO nova.compute.manager [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 20:54:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:08 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Deleted allocations for instance 5ac92e77-71c5-4aa5-bc70-ca5227a15e59
Nov 14 20:54:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61ea895f-720c-44cf-ae13-726f08d893fb tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.140s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-744ef109-367e-43ae-b70f-0bf9f1812b8e req-d5e097df-6477-48d5-98b8-fa062a09f731 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received event network-vif-plugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-744ef109-367e-43ae-b70f-0bf9f1812b8e req-d5e097df-6477-48d5-98b8-fa062a09f731 service nova] Acquiring lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-744ef109-367e-43ae-b70f-0bf9f1812b8e req-d5e097df-6477-48d5-98b8-fa062a09f731 service nova] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-744ef109-367e-43ae-b70f-0bf9f1812b8e req-d5e097df-6477-48d5-98b8-fa062a09f731 service nova] Lock "5ac92e77-71c5-4aa5-bc70-ca5227a15e59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-744ef109-367e-43ae-b70f-0bf9f1812b8e req-d5e097df-6477-48d5-98b8-fa062a09f731 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] No waiting events found dispatching network-vif-plugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:08 user nova-compute[76442]: WARNING nova.compute.manager [req-744ef109-367e-43ae-b70f-0bf9f1812b8e req-d5e097df-6477-48d5-98b8-fa062a09f731 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received unexpected event network-vif-plugged-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 for instance with vm_state deleted and task_state None.
Nov 14 20:54:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-744ef109-367e-43ae-b70f-0bf9f1812b8e req-d5e097df-6477-48d5-98b8-fa062a09f731 service nova] [instance: 5ac92e77-71c5-4aa5-bc70-ca5227a15e59] Received event network-vif-deleted-93cc42aa-5a97-4ae7-aebb-bb1e8d90a081 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:54:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:54:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:13 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:54:13 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:54:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:13 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:54:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:16 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:54:16 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8011MB free_disk=25.05170440673828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Applying migration context for instance 211f5689-1c50-4638-a3e4-deeafc6013cc as it has an incoming, in-progress migration da1d0635-2385-4038-afa3-d1a903e888d2. Migration status is finished {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 20:54:16 user nova-compute[76442]: INFO nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating resource usage from migration da1d0635-2385-4038-afa3-d1a903e888d2
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 16cd640b-de2b-488c-82d6-05c49cf526ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Migration da1d0635-2385-4038-afa3-d1a903e888d2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 211f5689-1c50-4638-a3e4-deeafc6013cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:54:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:54:17 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:54:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:54:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:54:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:54:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updating instance_info_cache with network_info: [{"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:54:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:54:18 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:54:18 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:54:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:54:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:54:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:26 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 16cd640b-de2b-488c-82d6-05c49cf526ef is timed out.
Nov 14 20:54:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Successfully detached device vdb from instance 16cd640b-de2b-488c-82d6-05c49cf526ef from the live domain config.
Nov 14 20:54:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMRgkcxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:54:26 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a861544a-39ed-4029-86d5-381bd0afc95a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:54:26 user nova-compute[76442]: No targets found.
Nov 14 20:54:26 user nova-compute[76442]: iSNS:
Nov 14 20:54:26 user nova-compute[76442]: No targets found.
Nov 14 20:54:26 user nova-compute[76442]: STATIC:
Nov 14 20:54:26 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09
Nov 14 20:54:26 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:26 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:26 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:54:26 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:54:26 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:54:26 user nova-compute[76442]: FIRMWARE:
Nov 14 20:54:26 user nova-compute[76442]: No targets found.
Nov 14 20:54:26 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:54:26 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:54:26 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8b21d5-0a85-4d39-90ff-cdd591d3ae00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14c9425-0b8a-4997-a775-4c447a6e7785]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:54:26 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:54:26 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 (non-flash)
Nov 14 20:54:26 user nova-compute[76442]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:54:26 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e8161240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09'): ({'sde'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Removing single pathed devices sde {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62dec8-5f85-49ed-8b7f-7a33a86b5bcc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e25b334-247e-44e1-984a-0cbdb6d69bd6]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Flushing IO for device /dev/sde {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe001fae-9c5b-4eee-be31-6601885a0bca]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[285686c5-cb77-4d4f-ade2-4e1c8c4a9073]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[22507c7b-d6d3-4b5d-98d8-bb7d469abc00]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[49969309-82d7-4175-ba1c-10b582159b46]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09, portal: 172.16.0.220,3260]
Nov 14 20:54:26 user nova-compute[76442]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09, portal: 172.16.0.220,3260] successful.
Nov 14 20:54:26 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e675f057-9fc6-47ee-9a10-c60d05e72b09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc39a6c-798f-480c-b2e5-1c5a708a998c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] <== disconnect_volume: return (290ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:54:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:54:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:27 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'flavor' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:54:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0f443c7b-24d6-4930-a045-4d75ca788197 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.659s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:31 user nova-compute[76442]: INFO nova.compute.manager [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Terminating instance
Nov 14 20:54:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-125cbc18-9544-43e7-ab7b-3ebf8da48280 req-eedd2dd8-9dcd-4407-96ca-05849b5cb91b service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-unplugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-125cbc18-9544-43e7-ab7b-3ebf8da48280 req-eedd2dd8-9dcd-4407-96ca-05849b5cb91b service nova] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-125cbc18-9544-43e7-ab7b-3ebf8da48280 req-eedd2dd8-9dcd-4407-96ca-05849b5cb91b service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-125cbc18-9544-43e7-ab7b-3ebf8da48280 req-eedd2dd8-9dcd-4407-96ca-05849b5cb91b service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-125cbc18-9544-43e7-ab7b-3ebf8da48280 req-eedd2dd8-9dcd-4407-96ca-05849b5cb91b service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] No waiting events found dispatching network-vif-unplugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-125cbc18-9544-43e7-ab7b-3ebf8da48280 req-eedd2dd8-9dcd-4407-96ca-05849b5cb91b service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-unplugged-8de88348-392e-4efb-aa6c-4f7cd492a169 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Instance destroyed successfully.
Nov 14 20:54:32 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lazy-loading 'resources' on Instance uuid a5970cb5-3f09-43c8-93ac-03053bc2f2cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:34:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1724729418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1724729418',id=1,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:35:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83568ed733848d09643843927ca0c42',ramdisk_id='',reservation_id='r-0j4f3cba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:36:49Z,user_data=None,user_id='4163211b006c4fbbbdc575c0e6d02ac8',uuid=a5970cb5-3f09-43c8-93ac-03053bc2f2cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converting VIF {"id": "8de88348-392e-4efb-aa6c-4f7cd492a169", "address": "fa:16:3e:2f:40:36", "network": {"id": "00df899f-04a5-49df-ae1d-43d662f9cb81", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1773206413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83568ed733848d09643843927ca0c42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de88348-39", "ovs_interfaceid": "8de88348-392e-4efb-aa6c-4f7cd492a169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:40:36,bridge_name='br-int',has_traffic_filtering=True,id=8de88348-392e-4efb-aa6c-4f7cd492a169,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de88348-39') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG os_vif [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:40:36,bridge_name='br-int',has_traffic_filtering=True,id=8de88348-392e-4efb-aa6c-4f7cd492a169,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de88348-39') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8de88348-39, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=717eaa85-a7a1-4fac-90c9-eb1359ed0348) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: INFO os_vif [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:40:36,bridge_name='br-int',has_traffic_filtering=True,id=8de88348-392e-4efb-aa6c-4f7cd492a169,network=Network(00df899f-04a5-49df-ae1d-43d662f9cb81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de88348-39')
Nov 14 20:54:32 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Deleting instance files /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc_del
Nov 14 20:54:32 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Deletion of /opt/stack/data/nova/instances/a5970cb5-3f09-43c8-93ac-03053bc2f2cc_del complete
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: INFO nova.compute.manager [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 20:54:32 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:32 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:33 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Took 0.82 seconds to deallocate network for instance.
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:33 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Deleted allocations for instance a5970cb5-3f09-43c8-93ac-03053bc2f2cc
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0609d33e-ff04-4b26-9de5-ae369ae548ca tempest-ServerBootFromVolumeStableRescueTest-1547619353 tempest-ServerBootFromVolumeStableRescueTest-1547619353-project-member] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] No waiting events found dispatching network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:33 user nova-compute[76442]: WARNING nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received unexpected event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 for instance with vm_state deleted and task_state None.
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] No waiting events found dispatching network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:33 user nova-compute[76442]: WARNING nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received unexpected event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 for instance with vm_state deleted and task_state None.
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] No waiting events found dispatching network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:33 user nova-compute[76442]: WARNING nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received unexpected event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 for instance with vm_state deleted and task_state None.
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-unplugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] No waiting events found dispatching network-vif-unplugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:33 user nova-compute[76442]: WARNING nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received unexpected event network-vif-unplugged-8de88348-392e-4efb-aa6c-4f7cd492a169 for instance with vm_state deleted and task_state None.
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Acquiring lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] Lock "a5970cb5-3f09-43c8-93ac-03053bc2f2cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] No waiting events found dispatching network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:33 user nova-compute[76442]: WARNING nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received unexpected event network-vif-plugged-8de88348-392e-4efb-aa6c-4f7cd492a169 for instance with vm_state deleted and task_state None.
Nov 14 20:54:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-43677104-b181-421a-ac4d-5f4b4f998f4b req-3e501367-e49e-4d52-a01b-b7137798b925 service nova] [instance: a5970cb5-3f09-43c8-93ac-03053bc2f2cc] Received event network-vif-deleted-8de88348-392e-4efb-aa6c-4f7cd492a169 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:54:44 user nova-compute[76442]: INFO nova.compute.claims [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Claim successful on node user
Nov 14 20:54:44 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:54:44 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:54:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:54:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:54:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Creating image(s)
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "/opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "/opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "/opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG nova.policy [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd972568e27ee4a838e978c8d220699f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ecfb771a114113bdcdf1881fcb5f62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk 1073741824" returned: 0 in 0.048s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Cannot resize image /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Ensure instance console log exists: /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:46 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Successfully created port: 6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:54:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Successfully updated port: 6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "refresh_cache-62d7a041-871d-458f-8de8-db7a53813244" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquired lock "refresh_cache-62d7a041-871d-458f-8de8-db7a53813244" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-3d9ea92a-6e90-4278-85cb-e6247afd4be1 req-f1991e3d-e34d-4ecf-8fec-ed6c9fa5e812 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received event network-changed-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-3d9ea92a-6e90-4278-85cb-e6247afd4be1 req-f1991e3d-e34d-4ecf-8fec-ed6c9fa5e812 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Refreshing instance network info cache due to event network-changed-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3d9ea92a-6e90-4278-85cb-e6247afd4be1 req-f1991e3d-e34d-4ecf-8fec-ed6c9fa5e812 service nova] Acquiring lock "refresh_cache-62d7a041-871d-458f-8de8-db7a53813244" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.neutron [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Updating instance_info_cache with network_info: [{"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Releasing lock "refresh_cache-62d7a041-871d-458f-8de8-db7a53813244" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Instance network_info: |[{"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3d9ea92a-6e90-4278-85cb-e6247afd4be1 req-f1991e3d-e34d-4ecf-8fec-ed6c9fa5e812 service nova] Acquired lock "refresh_cache-62d7a041-871d-458f-8de8-db7a53813244" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-3d9ea92a-6e90-4278-85cb-e6247afd4be1 req-f1991e3d-e34d-4ecf-8fec-ed6c9fa5e812 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Refreshing network info cache for port 6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Start _get_guest_xml network_info=[{"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:47 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:54:47 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1608034560',display_name='tempest-VolumesSnapshotTestJSON-instance-1608034560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1608034560',id=39,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOAUVGF8CseA3SKzZYX0u4K1ChhAaioAvznV5SlzDy4TJz2mXeAWrTHT1TksCOJo3Edlq+BFYVfpr426w6ujEK/xmvbo/xjsGJ71z4wI7BBH9o/BK7R+uQLMovy5zdTTw==',key_name='tempest-keypair-1084862179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23ecfb771a114113bdcdf1881fcb5f62',ramdisk_id='',reservation_id='r-a62newqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1708796007',owner_user_name='tempest-VolumesSnapshotTestJSON-1708796007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d972568e27ee4a838e978c8d220699f0',uuid=62d7a041-871d-458f-8de8-db7a53813244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converting VIF {"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:8c:1e,bridge_name='br-int',has_traffic_filtering=True,id=6e29f03d-f3ce-4c1a-9081-d37d3fe235ab,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e29f03d-f3') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'pci_devices' on Instance uuid 62d7a041-871d-458f-8de8-db7a53813244 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:54:47 user nova-compute[76442]:   <uuid>62d7a041-871d-458f-8de8-db7a53813244</uuid>
Nov 14 20:54:47 user nova-compute[76442]:   <name>instance-00000027</name>
Nov 14 20:54:47 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:54:47 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:54:47 user nova-compute[76442]:   <metadata>
Nov 14 20:54:47 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:54:47 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:54:47 user nova-compute[76442]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1608034560</nova:name>
Nov 14 20:54:47 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:54:47</nova:creationTime>
Nov 14 20:54:47 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:54:47 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:54:47 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:54:47 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:54:47 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:54:47 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:54:47 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:54:47 user nova-compute[76442]:       <nova:owner>
Nov 14 20:54:47 user nova-compute[76442]:         <nova:user uuid="d972568e27ee4a838e978c8d220699f0">tempest-VolumesSnapshotTestJSON-1708796007-project-member</nova:user>
Nov 14 20:54:47 user nova-compute[76442]:         <nova:project uuid="23ecfb771a114113bdcdf1881fcb5f62">tempest-VolumesSnapshotTestJSON-1708796007</nova:project>
Nov 14 20:54:47 user nova-compute[76442]:       </nova:owner>
Nov 14 20:54:47 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:54:47 user nova-compute[76442]:       <nova:ports>
Nov 14 20:54:47 user nova-compute[76442]:         <nova:port uuid="6e29f03d-f3ce-4c1a-9081-d37d3fe235ab">
Nov 14 20:54:47 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 20:54:47 user nova-compute[76442]:         </nova:port>
Nov 14 20:54:47 user nova-compute[76442]:       </nova:ports>
Nov 14 20:54:47 user nova-compute[76442]:     </nova:instance>
Nov 14 20:54:47 user nova-compute[76442]:   </metadata>
Nov 14 20:54:47 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:54:47 user nova-compute[76442]:     <system>
Nov 14 20:54:47 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:54:47 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:54:47 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:54:47 user nova-compute[76442]:       <entry name="serial">62d7a041-871d-458f-8de8-db7a53813244</entry>
Nov 14 20:54:47 user nova-compute[76442]:       <entry name="uuid">62d7a041-871d-458f-8de8-db7a53813244</entry>
Nov 14 20:54:47 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:54:47 user nova-compute[76442]:     </system>
Nov 14 20:54:47 user nova-compute[76442]:   </sysinfo>
Nov 14 20:54:47 user nova-compute[76442]:   <os>
Nov 14 20:54:47 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:54:47 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:54:47 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:54:47 user nova-compute[76442]:   </os>
Nov 14 20:54:47 user nova-compute[76442]:   <features>
Nov 14 20:54:47 user nova-compute[76442]:     <acpi/>
Nov 14 20:54:47 user nova-compute[76442]:     <apic/>
Nov 14 20:54:47 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:54:47 user nova-compute[76442]:   </features>
Nov 14 20:54:47 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:54:47 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:54:47 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:54:47 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:54:47 user nova-compute[76442]:   </clock>
Nov 14 20:54:47 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:54:47 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:54:47 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:54:47 user nova-compute[76442]:   </cpu>
Nov 14 20:54:47 user nova-compute[76442]:   <devices>
Nov 14 20:54:47 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:54:47 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:54:47 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk"/>
Nov 14 20:54:47 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:54:47 user nova-compute[76442]:     </disk>
Nov 14 20:54:47 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:54:47 user nova-compute[76442]:       <mac address="fa:16:3e:0e:8c:1e"/>
Nov 14 20:54:47 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:54:47 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:54:47 user nova-compute[76442]:       <target dev="tap6e29f03d-f3"/>
Nov 14 20:54:47 user nova-compute[76442]:     </interface>
Nov 14 20:54:47 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:54:47 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/console.log" append="off"/>
Nov 14 20:54:47 user nova-compute[76442]:     </serial>
Nov 14 20:54:47 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:54:47 user nova-compute[76442]:     <video>
Nov 14 20:54:47 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:54:47 user nova-compute[76442]:     </video>
Nov 14 20:54:47 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:54:47 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:54:47 user nova-compute[76442]:     </rng>
Nov 14 20:54:47 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:54:47 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:54:47 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:54:47 user nova-compute[76442]:     </memballoon>
Nov 14 20:54:47 user nova-compute[76442]:   </devices>
Nov 14 20:54:47 user nova-compute[76442]: </domain>
Nov 14 20:54:47 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1608034560',display_name='tempest-VolumesSnapshotTestJSON-instance-1608034560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1608034560',id=39,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOAUVGF8CseA3SKzZYX0u4K1ChhAaioAvznV5SlzDy4TJz2mXeAWrTHT1TksCOJo3Edlq+BFYVfpr426w6ujEK/xmvbo/xjsGJ71z4wI7BBH9o/BK7R+uQLMovy5zdTTw==',key_name='tempest-keypair-1084862179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23ecfb771a114113bdcdf1881fcb5f62',ramdisk_id='',reservation_id='r-a62newqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1708796007',owner_user_name='tempest-VolumesSnapshotTestJSON-1708796007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d972568e27ee4a838e978c8d220699f0',uuid=62d7a041-871d-458f-8de8-db7a53813244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converting VIF {"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:8c:1e,bridge_name='br-int',has_traffic_filtering=True,id=6e29f03d-f3ce-4c1a-9081-d37d3fe235ab,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e29f03d-f3') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG os_vif [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:8c:1e,bridge_name='br-int',has_traffic_filtering=True,id=6e29f03d-f3ce-4c1a-9081-d37d3fe235ab,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e29f03d-f3') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66db2c39-5a6c-5a02-b6b3-4d0bc5a84e19', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e29f03d-f3, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e29f03d-f3, col_values=(('qos', UUID('3d22355a-de79-4e0a-b3ad-63b5670b3065')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e29f03d-f3, col_values=(('external_ids', {'iface-id': '6e29f03d-f3ce-4c1a-9081-d37d3fe235ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:8c:1e', 'vm-uuid': '62d7a041-871d-458f-8de8-db7a53813244'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:47 user nova-compute[76442]: INFO os_vif [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:8c:1e,bridge_name='br-int',has_traffic_filtering=True,id=6e29f03d-f3ce-4c1a-9081-d37d3fe235ab,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e29f03d-f3')
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No VIF found with MAC fa:16:3e:0e:8c:1e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-3d9ea92a-6e90-4278-85cb-e6247afd4be1 req-f1991e3d-e34d-4ecf-8fec-ed6c9fa5e812 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Updated VIF entry in instance network info cache for port 6e29f03d-f3ce-4c1a-9081-d37d3fe235ab. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-3d9ea92a-6e90-4278-85cb-e6247afd4be1 req-f1991e3d-e34d-4ecf-8fec-ed6c9fa5e812 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Updating instance_info_cache with network_info: [{"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3d9ea92a-6e90-4278-85cb-e6247afd4be1 req-f1991e3d-e34d-4ecf-8fec-ed6c9fa5e812 service nova] Releasing lock "refresh_cache-62d7a041-871d-458f-8de8-db7a53813244" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:54:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-a6e33e59-3096-4b8e-97b2-95acf3263319 req-bcc51fbb-d2cc-4ac5-8262-d000e396ffb0 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received event network-vif-plugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a6e33e59-3096-4b8e-97b2-95acf3263319 req-bcc51fbb-d2cc-4ac5-8262-d000e396ffb0 service nova] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a6e33e59-3096-4b8e-97b2-95acf3263319 req-bcc51fbb-d2cc-4ac5-8262-d000e396ffb0 service nova] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a6e33e59-3096-4b8e-97b2-95acf3263319 req-bcc51fbb-d2cc-4ac5-8262-d000e396ffb0 service nova] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-a6e33e59-3096-4b8e-97b2-95acf3263319 req-bcc51fbb-d2cc-4ac5-8262-d000e396ffb0 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] No waiting events found dispatching network-vif-plugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:49 user nova-compute[76442]: WARNING nova.compute.manager [req-a6e33e59-3096-4b8e-97b2-95acf3263319 req-bcc51fbb-d2cc-4ac5-8262-d000e396ffb0 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received unexpected event network-vif-plugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab for instance with vm_state building and task_state spawning.
Nov 14 20:54:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:54:49 user nova-compute[76442]: INFO nova.compute.claims [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Claim successful on node user
Nov 14 20:54:50 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG nova.network.neutron [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:54:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:54:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG nova.policy [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64183849e82a427ea2e034ad39c70374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7ef39084aa4d8faaeb192c1eaf6874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:54:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Creating image(s)
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "/opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "/opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "/opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.197s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk 1073741824" returned: 0 in 0.051s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Successfully created port: 3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:54:51 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Instance spawned successfully.
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Cannot resize image /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Ensure instance console log exists: /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:51 user nova-compute[76442]: INFO nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:54:51 user nova-compute[76442]: INFO nova.compute.manager [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Took 6.92 seconds to build instance.
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9199267b-4401-4843-9cca-6689d3dfa069 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.017s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-72118e6d-e302-4f38-850a-ccceea8a7865 req-748380f2-46f6-49ab-85c3-3a4afa3a3523 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received event network-vif-plugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-72118e6d-e302-4f38-850a-ccceea8a7865 req-748380f2-46f6-49ab-85c3-3a4afa3a3523 service nova] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-72118e6d-e302-4f38-850a-ccceea8a7865 req-748380f2-46f6-49ab-85c3-3a4afa3a3523 service nova] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-72118e6d-e302-4f38-850a-ccceea8a7865 req-748380f2-46f6-49ab-85c3-3a4afa3a3523 service nova] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-72118e6d-e302-4f38-850a-ccceea8a7865 req-748380f2-46f6-49ab-85c3-3a4afa3a3523 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] No waiting events found dispatching network-vif-plugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:51 user nova-compute[76442]: WARNING nova.compute.manager [req-72118e6d-e302-4f38-850a-ccceea8a7865 req-748380f2-46f6-49ab-85c3-3a4afa3a3523 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received unexpected event network-vif-plugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab for instance with vm_state active and task_state None.
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.network.neutron [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Successfully updated port: 3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquired lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.network.neutron [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.network.neutron [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.network.neutron [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updating instance_info_cache with network_info: [{"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Releasing lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Instance network_info: |[{"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Start _get_guest_xml network_info=[{"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:54:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:54:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-119008924',display_name='tempest-TestStampPattern-server-119008924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-119008924',id=40,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvdINDy4N0nCmsxw9+z0YuoH3ORFDVbievK0y+5u+iZAsq6JkSs0vSSkOTyVGZyPAbS/GlayoYiP7LELDfKg0H397As/3cvk8b3zQIt0rEeH8Jo8IjV+llgBEk0dkVVig==',key_name='tempest-TestStampPattern-1089595662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7ef39084aa4d8faaeb192c1eaf6874',ramdisk_id='',reservation_id='r-oyww4q1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-369137228',owner_user_name='tempest-TestStampPattern-369137228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:54:50Z,user_data=None,user_id='64183849e82a427ea2e034ad39c70374',uuid=72f09c08-c10c-4449-941f-4dd5c9737d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converting VIF {"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:21:46,bridge_name='br-int',has_traffic_filtering=True,id=3894d600-3c72-4f8b-ba0c-d79b2519ecf5,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3894d600-3c') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.objects.instance [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'pci_devices' on Instance uuid 72f09c08-c10c-4449-941f-4dd5c9737d43 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:54:52 user nova-compute[76442]:   <uuid>72f09c08-c10c-4449-941f-4dd5c9737d43</uuid>
Nov 14 20:54:52 user nova-compute[76442]:   <name>instance-00000028</name>
Nov 14 20:54:52 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:54:52 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:54:52 user nova-compute[76442]:   <metadata>
Nov 14 20:54:52 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:54:52 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:54:52 user nova-compute[76442]:       <nova:name>tempest-TestStampPattern-server-119008924</nova:name>
Nov 14 20:54:52 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:54:52</nova:creationTime>
Nov 14 20:54:52 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:54:52 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:54:52 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:54:52 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:54:52 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:54:52 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:54:52 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:54:52 user nova-compute[76442]:       <nova:owner>
Nov 14 20:54:52 user nova-compute[76442]:         <nova:user uuid="64183849e82a427ea2e034ad39c70374">tempest-TestStampPattern-369137228-project-member</nova:user>
Nov 14 20:54:52 user nova-compute[76442]:         <nova:project uuid="1b7ef39084aa4d8faaeb192c1eaf6874">tempest-TestStampPattern-369137228</nova:project>
Nov 14 20:54:52 user nova-compute[76442]:       </nova:owner>
Nov 14 20:54:52 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:54:52 user nova-compute[76442]:       <nova:ports>
Nov 14 20:54:52 user nova-compute[76442]:         <nova:port uuid="3894d600-3c72-4f8b-ba0c-d79b2519ecf5">
Nov 14 20:54:52 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 20:54:52 user nova-compute[76442]:         </nova:port>
Nov 14 20:54:52 user nova-compute[76442]:       </nova:ports>
Nov 14 20:54:52 user nova-compute[76442]:     </nova:instance>
Nov 14 20:54:52 user nova-compute[76442]:   </metadata>
Nov 14 20:54:52 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:54:52 user nova-compute[76442]:     <system>
Nov 14 20:54:52 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:54:52 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:54:52 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:54:52 user nova-compute[76442]:       <entry name="serial">72f09c08-c10c-4449-941f-4dd5c9737d43</entry>
Nov 14 20:54:52 user nova-compute[76442]:       <entry name="uuid">72f09c08-c10c-4449-941f-4dd5c9737d43</entry>
Nov 14 20:54:52 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:54:52 user nova-compute[76442]:     </system>
Nov 14 20:54:52 user nova-compute[76442]:   </sysinfo>
Nov 14 20:54:52 user nova-compute[76442]:   <os>
Nov 14 20:54:52 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:54:52 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:54:52 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:54:52 user nova-compute[76442]:   </os>
Nov 14 20:54:52 user nova-compute[76442]:   <features>
Nov 14 20:54:52 user nova-compute[76442]:     <acpi/>
Nov 14 20:54:52 user nova-compute[76442]:     <apic/>
Nov 14 20:54:52 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:54:52 user nova-compute[76442]:   </features>
Nov 14 20:54:52 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:54:52 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:54:52 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:54:52 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:54:52 user nova-compute[76442]:   </clock>
Nov 14 20:54:52 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:54:52 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:54:52 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:54:52 user nova-compute[76442]:   </cpu>
Nov 14 20:54:52 user nova-compute[76442]:   <devices>
Nov 14 20:54:52 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:54:52 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:54:52 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk"/>
Nov 14 20:54:52 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:54:52 user nova-compute[76442]:     </disk>
Nov 14 20:54:52 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:54:52 user nova-compute[76442]:       <mac address="fa:16:3e:e5:21:46"/>
Nov 14 20:54:52 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:54:52 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:54:52 user nova-compute[76442]:       <target dev="tap3894d600-3c"/>
Nov 14 20:54:52 user nova-compute[76442]:     </interface>
Nov 14 20:54:52 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:54:52 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/console.log" append="off"/>
Nov 14 20:54:52 user nova-compute[76442]:     </serial>
Nov 14 20:54:52 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:54:52 user nova-compute[76442]:     <video>
Nov 14 20:54:52 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:54:52 user nova-compute[76442]:     </video>
Nov 14 20:54:52 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:54:52 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:54:52 user nova-compute[76442]:     </rng>
Nov 14 20:54:52 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:54:52 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:54:52 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:54:52 user nova-compute[76442]:     </memballoon>
Nov 14 20:54:52 user nova-compute[76442]:   </devices>
Nov 14 20:54:52 user nova-compute[76442]: </domain>
Nov 14 20:54:52 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-119008924',display_name='tempest-TestStampPattern-server-119008924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-119008924',id=40,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvdINDy4N0nCmsxw9+z0YuoH3ORFDVbievK0y+5u+iZAsq6JkSs0vSSkOTyVGZyPAbS/GlayoYiP7LELDfKg0H397As/3cvk8b3zQIt0rEeH8Jo8IjV+llgBEk0dkVVig==',key_name='tempest-TestStampPattern-1089595662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7ef39084aa4d8faaeb192c1eaf6874',ramdisk_id='',reservation_id='r-oyww4q1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-369137228',owner_user_name='tempest-TestStampPattern-369137228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:54:50Z,user_data=None,user_id='64183849e82a427ea2e034ad39c70374',uuid=72f09c08-c10c-4449-941f-4dd5c9737d43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converting VIF {"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:21:46,bridge_name='br-int',has_traffic_filtering=True,id=3894d600-3c72-4f8b-ba0c-d79b2519ecf5,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3894d600-3c') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG os_vif [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:21:46,bridge_name='br-int',has_traffic_filtering=True,id=3894d600-3c72-4f8b-ba0c-d79b2519ecf5,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3894d600-3c') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf6f3d7c-d63b-5c60-98f7-03a97f24e27d', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3894d600-3c, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3894d600-3c, col_values=(('qos', UUID('e1512d43-0ced-48b2-8ef8-c5ce29691ded')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3894d600-3c, col_values=(('external_ids', {'iface-id': '3894d600-3c72-4f8b-ba0c-d79b2519ecf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:21:46', 'vm-uuid': '72f09c08-c10c-4449-941f-4dd5c9737d43'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:52 user nova-compute[76442]: INFO os_vif [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:21:46,bridge_name='br-int',has_traffic_filtering=True,id=3894d600-3c72-4f8b-ba0c-d79b2519ecf5,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3894d600-3c')
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:54:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No VIF found with MAC fa:16:3e:e5:21:46, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:54:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-a17179bf-ea6e-4ad6-b7ee-1da683569c3c req-27c13468-e6cc-4071-87de-e5ee8146a439 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received event network-changed-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-a17179bf-ea6e-4ad6-b7ee-1da683569c3c req-27c13468-e6cc-4071-87de-e5ee8146a439 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Refreshing instance network info cache due to event network-changed-3894d600-3c72-4f8b-ba0c-d79b2519ecf5. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:54:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a17179bf-ea6e-4ad6-b7ee-1da683569c3c req-27c13468-e6cc-4071-87de-e5ee8146a439 service nova] Acquiring lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:54:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a17179bf-ea6e-4ad6-b7ee-1da683569c3c req-27c13468-e6cc-4071-87de-e5ee8146a439 service nova] Acquired lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:54:53 user nova-compute[76442]: DEBUG nova.network.neutron [req-a17179bf-ea6e-4ad6-b7ee-1da683569c3c req-27c13468-e6cc-4071-87de-e5ee8146a439 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Refreshing network info cache for port 3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:54:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:54 user nova-compute[76442]: DEBUG nova.network.neutron [req-a17179bf-ea6e-4ad6-b7ee-1da683569c3c req-27c13468-e6cc-4071-87de-e5ee8146a439 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updated VIF entry in instance network info cache for port 3894d600-3c72-4f8b-ba0c-d79b2519ecf5. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:54:54 user nova-compute[76442]: DEBUG nova.network.neutron [req-a17179bf-ea6e-4ad6-b7ee-1da683569c3c req-27c13468-e6cc-4071-87de-e5ee8146a439 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updating instance_info_cache with network_info: [{"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a17179bf-ea6e-4ad6-b7ee-1da683569c3c req-27c13468-e6cc-4071-87de-e5ee8146a439 service nova] Releasing lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received event network-vif-plugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] No waiting events found dispatching network-vif-plugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:55 user nova-compute[76442]: WARNING nova.compute.manager [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received unexpected event network-vif-plugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 for instance with vm_state building and task_state spawning.
Nov 14 20:54:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received event network-vif-plugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] No waiting events found dispatching network-vif-plugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:55 user nova-compute[76442]: WARNING nova.compute.manager [req-02101789-a243-4d6f-8d57-5e10e19b0a14 req-81834828-1f4f-489a-ab03-5768754d9f56 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received unexpected event network-vif-plugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 for instance with vm_state building and task_state spawning.
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:55 user nova-compute[76442]: INFO nova.compute.manager [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Terminating instance
Nov 14 20:54:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:54:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Instance spawned successfully.
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:54:56 user nova-compute[76442]: INFO nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:54:56 user nova-compute[76442]: INFO nova.compute.manager [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Took 6.54 seconds to build instance.
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-615b240f-2987-4ffe-aaa2-785d78be0cd6 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.654s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Instance destroyed successfully.
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'resources' on Instance uuid 16cd640b-de2b-488c-82d6-05c49cf526ef {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1940446192',display_name='tempest-ServerRescueNegativeTestJSON-server-1940446192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1940446192',id=32,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgnXgFu74relfHlulTvLq9270uICYyFfK/4kFO7eURj/wtc1sNY6gK2CDVnpxY7VAiTVGE+O8mDzv3nEpSbG0x4Zmzimj0ejtyt0mW2iNwN6eAq6WVzhQJ3T53Qi32cLQ==',key_name='tempest-keypair-1017385623',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-x9vrzi8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:52:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d5a850b0e6c48359f78aa669b038897',uuid=16cd640b-de2b-488c-82d6-05c49cf526ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "ea269041-ffaf-4db5-93cf-170276a43527", "address": "fa:16:3e:97:fe:40", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea269041-ff", "ovs_interfaceid": "ea269041-ffaf-4db5-93cf-170276a43527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:fe:40,bridge_name='br-int',has_traffic_filtering=True,id=ea269041-ffaf-4db5-93cf-170276a43527,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea269041-ff') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG os_vif [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:fe:40,bridge_name='br-int',has_traffic_filtering=True,id=ea269041-ffaf-4db5-93cf-170276a43527,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea269041-ff') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea269041-ff, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5c4961f-5781-4e0a-ac11-4a260971cc09) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:56 user nova-compute[76442]: INFO os_vif [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:fe:40,bridge_name='br-int',has_traffic_filtering=True,id=ea269041-ffaf-4db5-93cf-170276a43527,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea269041-ff')
Nov 14 20:54:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Deleting instance files /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef_del
Nov 14 20:54:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Deletion of /opt/stack/data/nova/instances/16cd640b-de2b-488c-82d6-05c49cf526ef_del complete
Nov 14 20:54:56 user nova-compute[76442]: INFO nova.compute.manager [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 20:54:56 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:54:56 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:54:57 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Took 0.86 seconds to deallocate network for instance.
Nov 14 20:54:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:57 user nova-compute[76442]: WARNING nova.compute.manager [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-unplugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state deleted and task_state None.
Nov 14 20:54:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] Acquiring lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] No waiting events found dispatching network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:54:57 user nova-compute[76442]: WARNING nova.compute.manager [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received unexpected event network-vif-plugged-ea269041-ffaf-4db5-93cf-170276a43527 for instance with vm_state deleted and task_state None.
Nov 14 20:54:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-a40ffb65-6c94-45f9-b696-9df8098e53b5 req-4f775a1e-a3b0-42b7-859c-223c2d0ead25 service nova] [instance: 16cd640b-de2b-488c-82d6-05c49cf526ef] Received event network-vif-deleted-ea269041-ffaf-4db5-93cf-170276a43527 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:54:58 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:54:58 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:54:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:54:58 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Deleted allocations for instance 16cd640b-de2b-488c-82d6-05c49cf526ef
Nov 14 20:54:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f483a392-9d32-49b7-bc7f-e8c730bf1f57 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "16cd640b-de2b-488c-82d6-05c49cf526ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:07 user nova-compute[76442]: DEBUG nova.compute.manager [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Going to confirm migration 2 {{(pid=76442) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquired lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG nova.objects.instance [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'info_cache' on Instance uuid 211f5689-1c50-4638-a3e4-deeafc6013cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG nova.network.neutron [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating instance_info_cache with network_info: [{"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Releasing lock "refresh_cache-211f5689-1c50-4638-a3e4-deeafc6013cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG nova.objects.instance [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'migration_context' on Instance uuid 211f5689-1c50-4638-a3e4-deeafc6013cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG nova.objects.base [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Object Instance<211f5689-1c50-4638-a3e4-deeafc6013cc> lazy-loaded attributes: info_cache,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:55:08 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:55:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.403s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:09 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Deleted allocation for migration da1d0635-2385-4038-afa3-d1a903e888d2
Nov 14 20:55:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-3935b2eb-aed4-4ab3-af11-9c99602e7b0c tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.542s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:10 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:13 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:55:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=25.136390686035156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f9200286-76da-4cc2-8592-c46cfbd5e83e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 211f5689-1c50-4638-a3e4-deeafc6013cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 62d7a041-871d-458f-8de8-db7a53813244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 72f09c08-c10c-4449-941f-4dd5c9737d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:55:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:55:19 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:55:19 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:55:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:55:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:55:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 20:55:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:55:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:55:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG nova.objects.instance [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'flavor' on Instance uuid f372cd49-b14f-49ae-9ffe-722822ae4ad9 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:36 user nova-compute[76442]: INFO nova.compute.manager [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Attaching volume c915f799-42d0-4f0a-ba46-2b7621e57917 to /dev/vdb
Nov 14 20:55:36 user nova-compute[76442]: DEBUG os_brick.utils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a1789-4242-4e8c-8680-e5256039b383]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e217d7-743f-4318-83fd-9daa744e0705]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[019b9574-8e20-4a6a-8982-6c36659e227d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c3a5c-59b9-4965-be6c-1d7e828271af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:55:36 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:55:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e78951-dfad-4265-9f17-6851c7af51d6]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:55:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:55:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:55:37 user nova-compute[76442]: DEBUG os_brick.utils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:55:37 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating existing volume attachment record: 9ed72077-6fb6-4fbd-87fb-d173e002f580 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJdQeSbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:55:41 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:55:41 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:55:41 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a04d682-014e-496b-9f3c-a9b463ac812a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:55:41 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aceec97-eaf8-426d-baa2-556e206243c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917] added
Nov 14 20:55:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca36216-631c-47c8-b2a0-a6d804ad7e20]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5b6b5-9164-4846-a224-0b58a7af547b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJdQeSbH {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJdQeSbH" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c513f0a-5780-40f4-80f5-fd4e60e96a9c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJdQeSbH'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b8eecc-b709-462f-a2ef-7ea1c943d038]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aac0122-5686-431b-a8e2-6d17519c7e57]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:55:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:55:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe80f1a-fe14-4a22-b6f5-179ed353d789]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917, portal: 172.16.0.220,3260]
Nov 14 20:55:41 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917, portal: 172.16.0.220,3260] successful.
Nov 14 20:55:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fc9e28-cb2a-40f1-82fb-388349530e25]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed9fd50-de32-41b2-ba3e-8e4ff764eec5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:55:41 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:55:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:55:41 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:55:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7629a30-93ae-4597-867f-8c295efbc973]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:55:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:55:42 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:55:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJdQeSbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:55:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:55:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26461303264666537', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:55:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461303264666537', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:55:42 user nova-compute[76442]: DEBUG nova.objects.instance [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'flavor' on Instance uuid f372cd49-b14f-49ae-9ffe-722822ae4ad9 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:55:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:55:42 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:55:42 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 20:55:42 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:55:42 user nova-compute[76442]:   <serial>c915f799-42d0-4f0a-ba46-2b7621e57917</serial>
Nov 14 20:55:42 user nova-compute[76442]: </disk>
Nov 14 20:55:42 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:55:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:55:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:55:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] No VIF found with MAC fa:16:3e:93:60:73, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:55:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-819c3f5d-6691-409d-bb05-f1d144796ba1 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.481s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-e39294ae-b788-43d3-8014-d20c68bae3c8 req-cc2b6c52-6848-4d28-b9cf-39189f4b3d95 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-e39294ae-b788-43d3-8014-d20c68bae3c8 req-cc2b6c52-6848-4d28-b9cf-39189f4b3d95 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing instance network info cache due to event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:55:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e39294ae-b788-43d3-8014-d20c68bae3c8 req-cc2b6c52-6848-4d28-b9cf-39189f4b3d95 service nova] Acquiring lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:55:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e39294ae-b788-43d3-8014-d20c68bae3c8 req-cc2b6c52-6848-4d28-b9cf-39189f4b3d95 service nova] Acquired lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:55:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-e39294ae-b788-43d3-8014-d20c68bae3c8 req-cc2b6c52-6848-4d28-b9cf-39189f4b3d95 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:55:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-e39294ae-b788-43d3-8014-d20c68bae3c8 req-cc2b6c52-6848-4d28-b9cf-39189f4b3d95 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updated VIF entry in instance network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:55:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-e39294ae-b788-43d3-8014-d20c68bae3c8 req-cc2b6c52-6848-4d28-b9cf-39189f4b3d95 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating instance_info_cache with network_info: [{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:55:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e39294ae-b788-43d3-8014-d20c68bae3c8 req-cc2b6c52-6848-4d28-b9cf-39189f4b3d95 service nova] Releasing lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:55:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6726a00-a883-4548-a021-e95f76528584 req-2019c7d8-a474-4db0-bac8-25e63cec1b3d service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6726a00-a883-4548-a021-e95f76528584 req-2019c7d8-a474-4db0-bac8-25e63cec1b3d service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing instance network info cache due to event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6726a00-a883-4548-a021-e95f76528584 req-2019c7d8-a474-4db0-bac8-25e63cec1b3d service nova] Acquiring lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6726a00-a883-4548-a021-e95f76528584 req-2019c7d8-a474-4db0-bac8-25e63cec1b3d service nova] Acquired lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG nova.network.neutron [req-c6726a00-a883-4548-a021-e95f76528584 req-2019c7d8-a474-4db0-bac8-25e63cec1b3d service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:48 user nova-compute[76442]: INFO nova.compute.manager [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Rebooting instance
Nov 14 20:55:48 user nova-compute[76442]: DEBUG nova.network.neutron [req-c6726a00-a883-4548-a021-e95f76528584 req-2019c7d8-a474-4db0-bac8-25e63cec1b3d service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updated VIF entry in instance network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG nova.network.neutron [req-c6726a00-a883-4548-a021-e95f76528584 req-2019c7d8-a474-4db0-bac8-25e63cec1b3d service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating instance_info_cache with network_info: [{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6726a00-a883-4548-a021-e95f76528584 req-2019c7d8-a474-4db0-bac8-25e63cec1b3d service nova] Releasing lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquired lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:55:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:55:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating instance_info_cache with network_info: [{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:55:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Releasing lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:55:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:51 user nova-compute[76442]: INFO nova.compute.manager [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Terminating instance
Nov 14 20:55:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-8ef5484a-7201-46db-8ad0-3f4966f38b90 req-0e996d6d-bc03-4a92-9c63-6116da05b9a4 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-unplugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8ef5484a-7201-46db-8ad0-3f4966f38b90 req-0e996d6d-bc03-4a92-9c63-6116da05b9a4 service nova] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8ef5484a-7201-46db-8ad0-3f4966f38b90 req-0e996d6d-bc03-4a92-9c63-6116da05b9a4 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8ef5484a-7201-46db-8ad0-3f4966f38b90 req-0e996d6d-bc03-4a92-9c63-6116da05b9a4 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-8ef5484a-7201-46db-8ad0-3f4966f38b90 req-0e996d6d-bc03-4a92-9c63-6116da05b9a4 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] No waiting events found dispatching network-vif-unplugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:51 user nova-compute[76442]: WARNING nova.compute.manager [req-8ef5484a-7201-46db-8ad0-3f4966f38b90 req-0e996d6d-bc03-4a92-9c63-6116da05b9a4 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received unexpected event network-vif-unplugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 for instance with vm_state active and task_state reboot_started.
Nov 14 20:55:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Instance shutdown successfully.
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Instance destroyed successfully.
Nov 14 20:55:52 user nova-compute[76442]: DEBUG nova.objects.instance [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'resources' on Instance uuid f9200286-76da-4cc2-8592-c46cfbd5e83e {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1584248445',display_name='tempest-ServerRescueNegativeTestJSON-server-1584248445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1584248445',id=19,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:41:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-oqv0u6ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:41:44Z,user_data=None,user_id='5d5a850b0e6c48359f78aa669b038897',uuid=f9200286-76da-4cc2-8592-c46cfbd5e83e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "address": "fa:16:3e:f4:af:b5", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c7f1f0-36", "ovs_interfaceid": "54c7f1f0-36f9-40ec-9349-81a3a62afe53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=54c7f1f0-36f9-40ec-9349-81a3a62afe53,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c7f1f0-36') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG os_vif [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=54c7f1f0-36f9-40ec-9349-81a3a62afe53,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c7f1f0-36') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54c7f1f0-36, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=710c13e5-390a-426b-939e-bd49a7cd4fb3) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:52 user nova-compute[76442]: INFO os_vif [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:af:b5,bridge_name='br-int',has_traffic_filtering=True,id=54c7f1f0-36f9-40ec-9349-81a3a62afe53,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c7f1f0-36')
Nov 14 20:55:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Deleting instance files /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e_del
Nov 14 20:55:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Deletion of /opt/stack/data/nova/instances/f9200286-76da-4cc2-8592-c46cfbd5e83e_del complete
Nov 14 20:55:52 user nova-compute[76442]: INFO nova.compute.manager [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 14 20:55:52 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:55:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:55:53 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Took 0.48 seconds to deallocate network for instance.
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-414d9f02-0b01-44ee-814a-2d3c49cba77c req-ae8d5895-a789-4a81-bea5-03c811c2e4ad service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-deleted-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:53 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Deleted allocations for instance f9200286-76da-4cc2-8592-c46cfbd5e83e
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] No waiting events found dispatching network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:53 user nova-compute[76442]: WARNING nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received unexpected event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 for instance with vm_state active and task_state reboot_started.
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-unplugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-unplugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:53 user nova-compute[76442]: WARNING nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-unplugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state deleted and task_state None.
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:53 user nova-compute[76442]: WARNING nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state deleted and task_state None.
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:53 user nova-compute[76442]: WARNING nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state deleted and task_state None.
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:53 user nova-compute[76442]: WARNING nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state deleted and task_state None.
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-unplugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-unplugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:53 user nova-compute[76442]: WARNING nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-unplugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state deleted and task_state None.
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Acquiring lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] No waiting events found dispatching network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:53 user nova-compute[76442]: WARNING nova.compute.manager [req-ecf5dfdf-f4aa-4125-b8ca-50d1919ebc48 req-f97cab93-f4d8-4157-9413-6ac34983e741 service nova] [instance: f9200286-76da-4cc2-8592-c46cfbd5e83e] Received unexpected event network-vif-plugged-54c7f1f0-36f9-40ec-9349-81a3a62afe53 for instance with vm_state deleted and task_state None.
Nov 14 20:55:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fec4f7bf-d83d-478b-8bde-3c0e4bff58f6 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "f9200286-76da-4cc2-8592-c46cfbd5e83e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.228s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:55 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Instance running successfully.
Nov 14 20:55:55 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Instance soft rebooted successfully.
Nov 14 20:55:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:55:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] No waiting events found dispatching network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:55 user nova-compute[76442]: WARNING nova.compute.manager [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received unexpected event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 for instance with vm_state active and task_state reboot_started.
Nov 14 20:55:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:55:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:55:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:55:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] No waiting events found dispatching network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:55:55 user nova-compute[76442]: WARNING nova.compute.manager [req-0beb33bb-4771-454c-b285-7e904340a9ff req-03f1fdcc-2c56-445a-af93-98e015a681dc service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received unexpected event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 for instance with vm_state active and task_state reboot_started.
Nov 14 20:55:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b805d949-c22f-43a3-af4b-5ee69171753d tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.210s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:55:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:55:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:56:10 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:11 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:13 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:15 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:56:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:56:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:56:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8167MB free_disk=25.15039825439453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 211f5689-1c50-4638-a3e4-deeafc6013cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 62d7a041-871d-458f-8de8-db7a53813244 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 72f09c08-c10c-4449-941f-4dd5c9737d43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 20:56:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 20:56:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:56:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 20:56:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:56:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:56:20 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:56:20 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:56:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updating instance_info_cache with network_info: [{"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:56:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-ceeb436d-1451-4477-8f02-60d1e3a52d93" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:56:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:56:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:56:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:56:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 20:56:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "89d63489-51be-4620-ae51-c5a84a14ccfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:56:35 user nova-compute[76442]: INFO nova.compute.claims [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Claim successful on node user
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-c882cce2-0b6c-498a-96d1-73a6fd43fa85 req-f79c6ed7-0a41-49fe-8bc7-a2abfae54d6b service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received event network-changed-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-c882cce2-0b6c-498a-96d1-73a6fd43fa85 req-f79c6ed7-0a41-49fe-8bc7-a2abfae54d6b service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Refreshing instance network info cache due to event network-changed-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c882cce2-0b6c-498a-96d1-73a6fd43fa85 req-f79c6ed7-0a41-49fe-8bc7-a2abfae54d6b service nova] Acquiring lock "refresh_cache-62d7a041-871d-458f-8de8-db7a53813244" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c882cce2-0b6c-498a-96d1-73a6fd43fa85 req-f79c6ed7-0a41-49fe-8bc7-a2abfae54d6b service nova] Acquired lock "refresh_cache-62d7a041-871d-458f-8de8-db7a53813244" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-c882cce2-0b6c-498a-96d1-73a6fd43fa85 req-f79c6ed7-0a41-49fe-8bc7-a2abfae54d6b service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Refreshing network info cache for port 6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.network.neutron [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:56:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:56:35 user nova-compute[76442]: INFO nova.virt.block_device [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Booting with volume snapshot 202dd04d-7be3-42c3-aa5b-36d3eae8bb01 at /dev/vda
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.policy [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f2d3fa02ad4ccbb286f49b8e59563d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaf0b599d7c4224be5cab0f23b95157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.008s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.objects.instance [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'flavor' on Instance uuid 62d7a041-871d-458f-8de8-db7a53813244 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:56:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Ignoring supplied device name: /dev/vdb
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-c882cce2-0b6c-498a-96d1-73a6fd43fa85 req-f79c6ed7-0a41-49fe-8bc7-a2abfae54d6b service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Updated VIF entry in instance network info cache for port 6e29f03d-f3ce-4c1a-9081-d37d3fe235ab. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-c882cce2-0b6c-498a-96d1-73a6fd43fa85 req-f79c6ed7-0a41-49fe-8bc7-a2abfae54d6b service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Updating instance_info_cache with network_info: [{"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c882cce2-0b6c-498a-96d1-73a6fd43fa85 req-f79c6ed7-0a41-49fe-8bc7-a2abfae54d6b service nova] Releasing lock "refresh_cache-62d7a041-871d-458f-8de8-db7a53813244" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:35 user nova-compute[76442]: INFO nova.compute.manager [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Attaching volume 80e45077-f9ef-4d96-a119-94bfb44243ca to /dev/vdb
Nov 14 20:56:36 user nova-compute[76442]: DEBUG os_brick.utils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1ba803-9f66-46c4-9866-16c9e4910a96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c49af41-39c4-4ebd-aa10-8ab63a1a4cd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde0d25a-4c3e-46ae-b765-eec59cf1276f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acaf8a2-06e5-45d6-ad3c-13909da410a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:56:36 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d41ec4-6a1b-4871-9fcc-7f28f06f1107]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG os_brick.utils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Updating existing volume attachment record: 970adc6c-f687-4701-98ee-449b2429d756 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG nova.network.neutron [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Successfully created port: 767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG nova.network.neutron [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Successfully updated port: 767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "refresh_cache-89d63489-51be-4620-ae51-c5a84a14ccfe" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquired lock "refresh_cache-89d63489-51be-4620-ae51-c5a84a14ccfe" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:56:36 user nova-compute[76442]: DEBUG nova.network.neutron [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG nova.network.neutron [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-635669a1-9723-483d-bd2e-2f3182503ea0 req-e2a3d81b-a849-45b4-a2ff-9cb02f519863 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received event network-changed-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-635669a1-9723-483d-bd2e-2f3182503ea0 req-e2a3d81b-a849-45b4-a2ff-9cb02f519863 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Refreshing instance network info cache due to event network-changed-767a93be-e47f-4671-ac34-175f45a94fe7. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-635669a1-9723-483d-bd2e-2f3182503ea0 req-e2a3d81b-a849-45b4-a2ff-9cb02f519863 service nova] Acquiring lock "refresh_cache-89d63489-51be-4620-ae51-c5a84a14ccfe" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG nova.network.neutron [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Updating instance_info_cache with network_info: [{"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Releasing lock "refresh_cache-89d63489-51be-4620-ae51-c5a84a14ccfe" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Instance network_info: |[{"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-635669a1-9723-483d-bd2e-2f3182503ea0 req-e2a3d81b-a849-45b4-a2ff-9cb02f519863 service nova] Acquired lock "refresh_cache-89d63489-51be-4620-ae51-c5a84a14ccfe" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:56:37 user nova-compute[76442]: DEBUG nova.network.neutron [req-635669a1-9723-483d-bd2e-2f3182503ea0 req-e2a3d81b-a849-45b4-a2ff-9cb02f519863 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Refreshing network info cache for port 767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:56:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:38 user nova-compute[76442]: DEBUG nova.network.neutron [req-635669a1-9723-483d-bd2e-2f3182503ea0 req-e2a3d81b-a849-45b4-a2ff-9cb02f519863 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Updated VIF entry in instance network info cache for port 767a93be-e47f-4671-ac34-175f45a94fe7. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:56:38 user nova-compute[76442]: DEBUG nova.network.neutron [req-635669a1-9723-483d-bd2e-2f3182503ea0 req-e2a3d81b-a849-45b4-a2ff-9cb02f519863 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Updating instance_info_cache with network_info: [{"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:56:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-635669a1-9723-483d-bd2e-2f3182503ea0 req-e2a3d81b-a849-45b4-a2ff-9cb02f519863 service nova] Releasing lock "refresh_cache-89d63489-51be-4620-ae51-c5a84a14ccfe" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLHUaSMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:56:40 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:56:40 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:56:40 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[055f40b1-a401-46bf-9d17-efc3b932d6d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:56:40 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[807bb3e4-2555-4fcd-9df1-08c7535055e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca] added
Nov 14 20:56:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb5583-9756-46c3-9df0-30099ad62e1a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[212978b3-7b33-4ff9-9bdd-6d89679b4217]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLHUaSMs {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLHUaSMs" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3178d38b-6cc6-49d2-b0f2-96fd7cbbd96f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLHUaSMs'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd694ff2-22df-4092-ade6-cae4515c75c4]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9907a-ab97-4279-8e9a-cc57e32aa80b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:40 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:40 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8013fc-dcb4-4bcf-b81f-c9d118888741]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca, portal: 172.16.0.220,3260]
Nov 14 20:56:40 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca, portal: 172.16.0.220,3260] successful.
Nov 14 20:56:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.051s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[699dfff1-55c0-4488-a8ef-0b0533f07faa]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1297550c-ebfd-432d-9ba6-df06c79bc3d3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:40 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:40 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:40 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:40 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e57ecad-2f28-49c8-b3c8-d244d6e478c2]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.utils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c7025-a2db-4a84-b5e7-31b94797c8df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c7dcaf-f0a0-4ecd-a1d1-6e8d9e64f4aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[418335ee-c9dc-4b22-983a-afa564ac5fbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb88ac0-7b77-47d4-b69c-722c311ba255]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:56:41 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:56:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4a0685-09cf-4786-af39-0e61a35f4b2b]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.utils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Updating existing volume attachment record: aa861a79-974d-4166-acd9-b9c27a3b6faa {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLHUaSMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23764303964353935', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764303964353935', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG nova.objects.instance [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'flavor' on Instance uuid 62d7a041-871d-458f-8de8-db7a53813244 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:56:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:56:41 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:56:41 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 20:56:41 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:56:41 user nova-compute[76442]:   <serial>80e45077-f9ef-4d96-a119-94bfb44243ca</serial>
Nov 14 20:56:41 user nova-compute[76442]: </disk>
Nov 14 20:56:41 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] No VIF found with MAC fa:16:3e:0e:8c:1e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:42 user nova-compute[76442]: INFO nova.compute.manager [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Terminating instance
Nov 14 20:56:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-3efb2a23-2d1d-4a26-9966-0e660e83bbff req-9065cfb8-9be8-405e-83d7-ea73acfab34f service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received event network-changed-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-3efb2a23-2d1d-4a26-9966-0e660e83bbff req-9065cfb8-9be8-405e-83d7-ea73acfab34f service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Refreshing instance network info cache due to event network-changed-3894d600-3c72-4f8b-ba0c-d79b2519ecf5. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3efb2a23-2d1d-4a26-9966-0e660e83bbff req-9065cfb8-9be8-405e-83d7-ea73acfab34f service nova] Acquiring lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3efb2a23-2d1d-4a26-9966-0e660e83bbff req-9065cfb8-9be8-405e-83d7-ea73acfab34f service nova] Acquired lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG nova.network.neutron [req-3efb2a23-2d1d-4a26-9966-0e660e83bbff req-9065cfb8-9be8-405e-83d7-ea73acfab34f service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Refreshing network info cache for port 3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-217a5f11-6518-43f4-bf98-5ec663b333ab tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.601s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG nova.objects.instance [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'flavor' on Instance uuid 72f09c08-c10c-4449-941f-4dd5c9737d43 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:56:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:42 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Instance destroyed successfully.
Nov 14 20:56:42 user nova-compute[76442]: DEBUG nova.objects.instance [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lazy-loading 'resources' on Instance uuid ceeb436d-1451-4477-8f02-60d1e3a52d93 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:39:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-44444427',display_name='tempest-ServerRescueNegativeTestJSON-server-44444427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-44444427',id=18,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69cc7950cfcf40b180d65bc96e28a2e3',ramdisk_id='',reservation_id='r-59ap0w1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-916964129',owner_user_name='tempest-ServerRescueNegativeTestJSON-916964129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:46:28Z,user_data=None,user_id='5d5a850b0e6c48359f78aa669b038897',uuid=ceeb436d-1451-4477-8f02-60d1e3a52d93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converting VIF {"id": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "address": "fa:16:3e:6e:61:bc", "network": {"id": "ec22212c-2063-4e19-a161-b97bcc6d8bbf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2046648246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69cc7950cfcf40b180d65bc96e28a2e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ae3e9a-8d", "ovs_interfaceid": "64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:61:bc,bridge_name='br-int',has_traffic_filtering=True,id=64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3e9a-8d') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG os_vif [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:61:bc,bridge_name='br-int',has_traffic_filtering=True,id=64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3e9a-8d') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64ae3e9a-8d, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bc1bdf7-6fbb-4a9b-a059-57989129cde1) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:43 user nova-compute[76442]: INFO os_vif [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:61:bc,bridge_name='br-int',has_traffic_filtering=True,id=64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9,network=Network(ec22212c-2063-4e19-a161-b97bcc6d8bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ae3e9a-8d')
Nov 14 20:56:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Deleting instance files /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93_del
Nov 14 20:56:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Deletion of /opt/stack/data/nova/instances/ceeb436d-1451-4477-8f02-60d1e3a52d93_del complete
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.network.neutron [req-3efb2a23-2d1d-4a26-9966-0e660e83bbff req-9065cfb8-9be8-405e-83d7-ea73acfab34f service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updated VIF entry in instance network info cache for port 3894d600-3c72-4f8b-ba0c-d79b2519ecf5. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.network.neutron [req-3efb2a23-2d1d-4a26-9966-0e660e83bbff req-9065cfb8-9be8-405e-83d7-ea73acfab34f service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updating instance_info_cache with network_info: [{"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3efb2a23-2d1d-4a26-9966-0e660e83bbff req-9065cfb8-9be8-405e-83d7-ea73acfab34f service nova] Releasing lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:56:43 user nova-compute[76442]: INFO nova.compute.manager [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:43 user nova-compute[76442]: INFO nova.compute.manager [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Attaching volume 2a6de7fc-fe80-47d4-95b6-092376116003 to /dev/vdb
Nov 14 20:56:43 user nova-compute[76442]: DEBUG os_brick.utils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbc8a56-69ee-4861-b23e-8e92993a6735]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b1d2a3-9032-44f3-96b9-034061da466d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1952a97d-56d6-42c1-9e6c-ea4b823aa8b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[135fda51-f4a0-4404-bca9-ec41a1ca5815]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:56:43 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dac1a48-e8d1-4363-b46f-d13b98c8a804]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG os_brick.utils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updating existing volume attachment record: aa4291f4-bc1a-4c3f-8b86-7570125037ba {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-ad45340e-502d-44dd-b668-9ee65d3b1025 req-e9545290-e07f-4503-8170-b57e0acd79c8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-deleted-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:56:43 user nova-compute[76442]: INFO nova.compute.manager [req-ad45340e-502d-44dd-b668-9ee65d3b1025 req-e9545290-e07f-4503-8170-b57e0acd79c8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Neutron deleted interface 64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9; detaching it from the instance and deleting it from the info cache
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.network.neutron [req-ad45340e-502d-44dd-b668-9ee65d3b1025 req-e9545290-e07f-4503-8170-b57e0acd79c8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-ad45340e-502d-44dd-b668-9ee65d3b1025 req-e9545290-e07f-4503-8170-b57e0acd79c8 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Detach interface failed, port_id=64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9, reason: Instance ceeb436d-1451-4477-8f02-60d1e3a52d93 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:56:43 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Took 0.56 seconds to deallocate network for instance.
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:56:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:44 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Deleted allocations for instance ceeb436d-1451-4477-8f02-60d1e3a52d93
Nov 14 20:56:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c88d7ea5-b84f-4d47-a15c-42c3a91c7df3 tempest-ServerRescueNegativeTestJSON-916964129 tempest-ServerRescueNegativeTestJSON-916964129-project-member] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.729s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-unplugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:56:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-unplugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:56:44 user nova-compute[76442]: WARNING nova.compute.manager [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-unplugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state deleted and task_state None.
Nov 14 20:56:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:56:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] Acquiring lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] Lock "ceeb436d-1451-4477-8f02-60d1e3a52d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] No waiting events found dispatching network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:56:44 user nova-compute[76442]: WARNING nova.compute.manager [req-3b014915-baf5-426a-81e2-2b4182022b77 req-f6248ed7-fb73-4110-ad50-74d3ffb15a37 service nova] [instance: ceeb436d-1451-4477-8f02-60d1e3a52d93] Received unexpected event network-vif-plugged-64ae3e9a-8da1-40ec-9cfc-ceb56b65f7f9 for instance with vm_state deleted and task_state None.
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:56:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Creating image(s)
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Ensure instance console log exists: /opt/stack/data/nova/instances/89d63489-51be-4620-ae51-c5a84a14ccfe/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Start _get_guest_xml network_info=[{"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZkgvRDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89d63489-51be-4620-ae51-c5a84a14ccfe', 'attached_at': '', 'detached_at': '', 'volume_id': '7a5a493b-4d85-4612-bc55-36cb35e64229', 'serial': '7a5a493b-4d85-4612-bc55-36cb35e64229'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'aa861a79-974d-4166-acd9-b9c27a3b6faa', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:56:46 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:56:46 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZkgvRDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:56:46 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:56:46 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:56:46 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1461df-3dec-41ae-803f-50187692735d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:56:46 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[793161da-0e5f-4da0-a012-89bd240ed807]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229] added
Nov 14 20:56:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b1b712-0dc2-4675-bd06-9d9a610c520d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f6b59c-56d1-4541-a68f-d3683d5fe9e1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZkgvRDA {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VZkgvRDA" returned: 0 in 0.070s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff78060c-acb9-4d9d-9431-461add0f7852]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VZkgvRDA'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f21ef1-5fc5-440c-b50b-e760271c7e5e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ab857e-3c6d-4ffa-8329-b479c36c47eb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b1ef67-92ac-4ece-b32f-20ae4f1b36c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229, portal: 172.16.0.220,3260]
Nov 14 20:56:46 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229, portal: 172.16.0.220,3260] successful.
Nov 14 20:56:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6de5e-4093-47bc-bc34-bb4246b12228]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbcaa11-5e1c-4fa5-8867-88e961283e6d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:56:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:46 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:56:46 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8fc8e-90de-4076-9af8-afc1fbd25455]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:46 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZkgvRDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23036316139383964', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036316139383964', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-176601727',display_name='tempest-TestVolumeBootPattern-server-176601727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-176601727',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-pze5knmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:56:36Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=89d63489-51be-4620-ae51-c5a84a14ccfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=767a93be-e47f-4671-ac34-175f45a94fe7,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767a93be-e4') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'pci_devices' on Instance uuid 89d63489-51be-4620-ae51-c5a84a14ccfe {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:56:47 user nova-compute[76442]:   <uuid>89d63489-51be-4620-ae51-c5a84a14ccfe</uuid>
Nov 14 20:56:47 user nova-compute[76442]:   <name>instance-00000029</name>
Nov 14 20:56:47 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:56:47 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:56:47 user nova-compute[76442]:   <metadata>
Nov 14 20:56:47 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:56:47 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:56:47 user nova-compute[76442]:       <nova:name>tempest-TestVolumeBootPattern-server-176601727</nova:name>
Nov 14 20:56:47 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:56:46</nova:creationTime>
Nov 14 20:56:47 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:56:47 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:56:47 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:56:47 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:56:47 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:56:47 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:56:47 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:56:47 user nova-compute[76442]:       <nova:owner>
Nov 14 20:56:47 user nova-compute[76442]:         <nova:user uuid="85f2d3fa02ad4ccbb286f49b8e59563d">tempest-TestVolumeBootPattern-792728264-project-member</nova:user>
Nov 14 20:56:47 user nova-compute[76442]:         <nova:project uuid="bcaf0b599d7c4224be5cab0f23b95157">tempest-TestVolumeBootPattern-792728264</nova:project>
Nov 14 20:56:47 user nova-compute[76442]:       </nova:owner>
Nov 14 20:56:47 user nova-compute[76442]:       <nova:ports>
Nov 14 20:56:47 user nova-compute[76442]:         <nova:port uuid="767a93be-e47f-4671-ac34-175f45a94fe7">
Nov 14 20:56:47 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 20:56:47 user nova-compute[76442]:         </nova:port>
Nov 14 20:56:47 user nova-compute[76442]:       </nova:ports>
Nov 14 20:56:47 user nova-compute[76442]:     </nova:instance>
Nov 14 20:56:47 user nova-compute[76442]:   </metadata>
Nov 14 20:56:47 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:56:47 user nova-compute[76442]:     <system>
Nov 14 20:56:47 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:56:47 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:56:47 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:56:47 user nova-compute[76442]:       <entry name="serial">89d63489-51be-4620-ae51-c5a84a14ccfe</entry>
Nov 14 20:56:47 user nova-compute[76442]:       <entry name="uuid">89d63489-51be-4620-ae51-c5a84a14ccfe</entry>
Nov 14 20:56:47 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:56:47 user nova-compute[76442]:     </system>
Nov 14 20:56:47 user nova-compute[76442]:   </sysinfo>
Nov 14 20:56:47 user nova-compute[76442]:   <os>
Nov 14 20:56:47 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:56:47 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:56:47 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:56:47 user nova-compute[76442]:   </os>
Nov 14 20:56:47 user nova-compute[76442]:   <features>
Nov 14 20:56:47 user nova-compute[76442]:     <acpi/>
Nov 14 20:56:47 user nova-compute[76442]:     <apic/>
Nov 14 20:56:47 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:56:47 user nova-compute[76442]:   </features>
Nov 14 20:56:47 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:56:47 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:56:47 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:56:47 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:56:47 user nova-compute[76442]:   </clock>
Nov 14 20:56:47 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:56:47 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:56:47 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:56:47 user nova-compute[76442]:   </cpu>
Nov 14 20:56:47 user nova-compute[76442]:   <devices>
Nov 14 20:56:47 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:56:47 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:56:47 user nova-compute[76442]:       <source dev="/dev/sdd"/>
Nov 14 20:56:47 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:56:47 user nova-compute[76442]:       <serial>7a5a493b-4d85-4612-bc55-36cb35e64229</serial>
Nov 14 20:56:47 user nova-compute[76442]:     </disk>
Nov 14 20:56:47 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:56:47 user nova-compute[76442]:       <mac address="fa:16:3e:dd:9b:7b"/>
Nov 14 20:56:47 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:56:47 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:56:47 user nova-compute[76442]:       <target dev="tap767a93be-e4"/>
Nov 14 20:56:47 user nova-compute[76442]:     </interface>
Nov 14 20:56:47 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:56:47 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/89d63489-51be-4620-ae51-c5a84a14ccfe/console.log" append="off"/>
Nov 14 20:56:47 user nova-compute[76442]:     </serial>
Nov 14 20:56:47 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:56:47 user nova-compute[76442]:     <video>
Nov 14 20:56:47 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:56:47 user nova-compute[76442]:     </video>
Nov 14 20:56:47 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:56:47 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:56:47 user nova-compute[76442]:     </rng>
Nov 14 20:56:47 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:56:47 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:56:47 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:56:47 user nova-compute[76442]:     </memballoon>
Nov 14 20:56:47 user nova-compute[76442]:   </devices>
Nov 14 20:56:47 user nova-compute[76442]: </domain>
Nov 14 20:56:47 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-176601727',display_name='tempest-TestVolumeBootPattern-server-176601727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-176601727',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-pze5knmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:56:36Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=89d63489-51be-4620-ae51-c5a84a14ccfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=767a93be-e47f-4671-ac34-175f45a94fe7,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767a93be-e4') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG os_vif [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=767a93be-e47f-4671-ac34-175f45a94fe7,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767a93be-e4') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe2cfa6d-534d-5675-a66b-b99dce116e96', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap767a93be-e4, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap767a93be-e4, col_values=(('qos', UUID('e2d31ce4-411f-4e35-8d28-5c299a7fdab8')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap767a93be-e4, col_values=(('external_ids', {'iface-id': '767a93be-e47f-4671-ac34-175f45a94fe7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:9b:7b', 'vm-uuid': '89d63489-51be-4620-ae51-c5a84a14ccfe'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:47 user nova-compute[76442]: INFO os_vif [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=767a93be-e47f-4671-ac34-175f45a94fe7,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767a93be-e4')
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:56:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No VIF found with MAC fa:16:3e:dd:9b:7b, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:56:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUoLCcxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:56:49 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:56:49 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:56:49 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-73d2e0f5-7cda-40d7-af7c-8e785ca8905b req-684003c4-fa3b-4134-9cd3-c04788cc57bb service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received event network-vif-plugged-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-73d2e0f5-7cda-40d7-af7c-8e785ca8905b req-684003c4-fa3b-4134-9cd3-c04788cc57bb service nova] Acquiring lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-73d2e0f5-7cda-40d7-af7c-8e785ca8905b req-684003c4-fa3b-4134-9cd3-c04788cc57bb service nova] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-73d2e0f5-7cda-40d7-af7c-8e785ca8905b req-684003c4-fa3b-4134-9cd3-c04788cc57bb service nova] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-73d2e0f5-7cda-40d7-af7c-8e785ca8905b req-684003c4-fa3b-4134-9cd3-c04788cc57bb service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] No waiting events found dispatching network-vif-plugged-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:56:49 user nova-compute[76442]: WARNING nova.compute.manager [req-73d2e0f5-7cda-40d7-af7c-8e785ca8905b req-684003c4-fa3b-4134-9cd3-c04788cc57bb service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received unexpected event network-vif-plugged-767a93be-e47f-4671-ac34-175f45a94fe7 for instance with vm_state building and task_state spawning.
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30ef0c5-885b-4b94-bf0e-dc67aa6ed36f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:56:49 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2528285-7b92-416b-a852-8fc42554a1eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003] added
Nov 14 20:56:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe2f314-8a6b-45ff-b24f-d97a20e1ecc9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc92e1d-0b6b-423a-9220-dd25b9cff2b6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUoLCcxm {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUoLCcxm" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f15824-eee2-406e-b895-e95a0f9a9d09]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iUoLCcxm'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5021b5f4-d200-4c96-b2f0-38350343d038]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf3295e-a2af-426c-b5ca-7dcd1e3a9ce6]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd37191-600e-45ec-9cfe-2241b75f4712]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003, portal: 172.16.0.220,3260]
Nov 14 20:56:49 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003, portal: 172.16.0.220,3260] successful.
Nov 14 20:56:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c9b496-0ee8-4aea-8db1-880819c42f39]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f0cb7a-9cc2-4214-826f-2658a8bac9c8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 (non-flash)
Nov 14 20:56:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1a670e-9e8a-48cc-87d9-d75b5fe4d87e]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUoLCcxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:56:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26365636166383931', 'path': '/dev/sde'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:56:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365636166383931', 'path': '/dev/sde'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:56:50 user nova-compute[76442]: DEBUG nova.objects.instance [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'flavor' on Instance uuid 72f09c08-c10c-4449-941f-4dd5c9737d43 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:56:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:56:50 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:56:50 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:56:50 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:56:50 user nova-compute[76442]:   <serial>2a6de7fc-fe80-47d4-95b6-092376116003</serial>
Nov 14 20:56:50 user nova-compute[76442]: </disk>
Nov 14 20:56:50 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:56:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:56:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:56:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No VIF found with MAC fa:16:3e:e5:21:46, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-46ff2e07-c208-41b8-a074-05e4a99b5122 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.970s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:56:51 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Instance spawned successfully.
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:56:51 user nova-compute[76442]: INFO nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-0e444492-b913-4ceb-b5f2-c0ddca746b1f req-73e1ffa4-20b8-4297-94fc-66e6a46867d8 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received event network-vif-plugged-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e444492-b913-4ceb-b5f2-c0ddca746b1f req-73e1ffa4-20b8-4297-94fc-66e6a46867d8 service nova] Acquiring lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e444492-b913-4ceb-b5f2-c0ddca746b1f req-73e1ffa4-20b8-4297-94fc-66e6a46867d8 service nova] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0e444492-b913-4ceb-b5f2-c0ddca746b1f req-73e1ffa4-20b8-4297-94fc-66e6a46867d8 service nova] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:51 user nova-compute[76442]: DEBUG nova.compute.manager [req-0e444492-b913-4ceb-b5f2-c0ddca746b1f req-73e1ffa4-20b8-4297-94fc-66e6a46867d8 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] No waiting events found dispatching network-vif-plugged-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:56:51 user nova-compute[76442]: WARNING nova.compute.manager [req-0e444492-b913-4ceb-b5f2-c0ddca746b1f req-73e1ffa4-20b8-4297-94fc-66e6a46867d8 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received unexpected event network-vif-plugged-767a93be-e47f-4671-ac34-175f45a94fe7 for instance with vm_state building and task_state spawning.
Nov 14 20:56:51 user nova-compute[76442]: INFO nova.compute.manager [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Took 16.19 seconds to build instance.
Nov 14 20:56:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ea749ddc-6abb-4d7b-b106-8b01f72a6857 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.296s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:56:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:52 user nova-compute[76442]: INFO nova.compute.manager [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Detaching volume 80e45077-f9ef-4d96-a119-94bfb44243ca
Nov 14 20:56:52 user nova-compute[76442]: INFO nova.virt.block_device [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Attempting to driver detach volume 80e45077-f9ef-4d96-a119-94bfb44243ca from mountpoint /dev/vdb
Nov 14 20:56:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Attempting to detach device vdb from instance 62d7a041-871d-458f-8de8-db7a53813244 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:56:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:56:52 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:56:52 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 20:56:52 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:56:52 user nova-compute[76442]:   <serial>80e45077-f9ef-4d96-a119-94bfb44243ca</serial>
Nov 14 20:56:52 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:56:52 user nova-compute[76442]: </disk>
Nov 14 20:56:52 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:56:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Successfully detached device vdb from instance 62d7a041-871d-458f-8de8-db7a53813244 from the persistent domain config.
Nov 14 20:56:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62d7a041-871d-458f-8de8-db7a53813244 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:56:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:56:52 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:56:52 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 20:56:52 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:56:52 user nova-compute[76442]:   <serial>80e45077-f9ef-4d96-a119-94bfb44243ca</serial>
Nov 14 20:56:52 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:56:52 user nova-compute[76442]: </disk>
Nov 14 20:56:52 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:56:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62d7a041-871d-458f-8de8-db7a53813244 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:56:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:56:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:56:53 user nova-compute[76442]: INFO nova.compute.manager [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Detaching volume 2a6de7fc-fe80-47d4-95b6-092376116003
Nov 14 20:56:53 user nova-compute[76442]: INFO nova.virt.block_device [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Attempting to driver detach volume 2a6de7fc-fe80-47d4-95b6-092376116003 from mountpoint /dev/vdb
Nov 14 20:56:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Attempting to detach device vdb from instance 72f09c08-c10c-4449-941f-4dd5c9737d43 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:56:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:56:53 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:56:53 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:56:53 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:56:53 user nova-compute[76442]:   <serial>2a6de7fc-fe80-47d4-95b6-092376116003</serial>
Nov 14 20:56:53 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:56:53 user nova-compute[76442]: </disk>
Nov 14 20:56:53 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:56:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Successfully detached device vdb from instance 72f09c08-c10c-4449-941f-4dd5c9737d43 from the persistent domain config.
Nov 14 20:56:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72f09c08-c10c-4449-941f-4dd5c9737d43 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:56:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:56:53 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:56:53 user nova-compute[76442]:   <source dev="/dev/sde"/>
Nov 14 20:56:53 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:56:53 user nova-compute[76442]:   <serial>2a6de7fc-fe80-47d4-95b6-092376116003</serial>
Nov 14 20:56:53 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:56:53 user nova-compute[76442]: </disk>
Nov 14 20:56:53 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:56:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72f09c08-c10c-4449-941f-4dd5c9737d43 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:56:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:56:59 user nova-compute[76442]: INFO nova.compute.manager [None req-5eded0b7-deb9-4253-a98a-e7b50ac17144 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Get console output
Nov 14 20:56:59 user nova-compute[76442]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 20:57:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:10 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:13 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 62d7a041-871d-458f-8de8-db7a53813244 is timed out.
Nov 14 20:57:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Successfully detached device vdb from instance 62d7a041-871d-458f-8de8-db7a53813244 from the live domain config.
Nov 14 20:57:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLHUaSMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:57:13 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56dfdb-66fb-4029-89e9-1c96013eab46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:57:13 user nova-compute[76442]: No targets found.
Nov 14 20:57:13 user nova-compute[76442]: iSNS:
Nov 14 20:57:13 user nova-compute[76442]: No targets found.
Nov 14 20:57:13 user nova-compute[76442]: STATIC:
Nov 14 20:57:13 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003
Nov 14 20:57:13 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:13 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:13 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229
Nov 14 20:57:13 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:13 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:13 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca
Nov 14 20:57:13 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:13 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:13 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917
Nov 14 20:57:13 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:13 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:13 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:57:13 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:13 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:13 user nova-compute[76442]: FIRMWARE:
Nov 14 20:57:13 user nova-compute[76442]: No targets found.
Nov 14 20:57:13 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:57:13 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:57:13 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6334b727-4cfb-491e-9b48-d15f74d1dfc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca58a985-f24b-46b6-8e8d-518cb7e72d9d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:57:13 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:57:13 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:57:13 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:57:13 user nova-compute[76442]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 (non-flash)
Nov 14 20:57:13 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:57:13 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:57:13 user nova-compute[76442]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca (non-flash)
Nov 14 20:57:13 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:57:13 user nova-compute[76442]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 (non-flash)
Nov 14 20:57:13 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f070c455120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22148ff-61de-46de-9231-9ed571c683df]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a72622a-682a-4f55-a266-ccaf8d4af81d]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cb2923-b816-461e-8312-61be3d3dc16c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbc73cb-6881-41c0-bb33-c0e8a1114a74]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b26cc6-b662-473e-b0ee-fe1399bf2227]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[496a5197-b5a2-4626-b8d0-a9a51b6be524]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca, portal: 172.16.0.220,3260]
Nov 14 20:57:13 user nova-compute[76442]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca, portal: 172.16.0.220,3260] successful.
Nov 14 20:57:13 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f3d6a1-163c-45f6-8e21-be4652f9e4c8]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] <== disconnect_volume: return (294ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:57:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:57:14 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72f09c08-c10c-4449-941f-4dd5c9737d43 is timed out.
Nov 14 20:57:14 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Successfully detached device vdb from instance 72f09c08-c10c-4449-941f-4dd5c9737d43 from the live domain config.
Nov 14 20:57:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUoLCcxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:57:14 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[91365854-fedb-4c19-bf61-60b25b161971]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:57:14 user nova-compute[76442]: No targets found.
Nov 14 20:57:14 user nova-compute[76442]: iSNS:
Nov 14 20:57:14 user nova-compute[76442]: No targets found.
Nov 14 20:57:14 user nova-compute[76442]: STATIC:
Nov 14 20:57:14 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003
Nov 14 20:57:14 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:14 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:14 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229
Nov 14 20:57:14 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:14 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:14 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917
Nov 14 20:57:14 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:14 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:14 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:57:14 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:14 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:14 user nova-compute[76442]: FIRMWARE:
Nov 14 20:57:14 user nova-compute[76442]: No targets found.
Nov 14 20:57:14 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:57:14 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:57:14 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0114f2-9034-4189-8a02-45b757717215]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[533cab11-084d-40fc-ad73-a8b0597f38dd]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:57:14 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:57:14 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:57:14 user nova-compute[76442]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 (non-flash)
Nov 14 20:57:14 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:57:14 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:57:14 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:57:14 user nova-compute[76442]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 (non-flash)
Nov 14 20:57:14 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e85ada20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003'): ({'sde'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Removing single pathed devices sde {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5882dd73-ae93-46ff-a0ba-83578f31f6a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[35905393-8fdc-4db8-abd8-2669baafa08a]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Flushing IO for device /dev/sde {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[42841258-a8f6-485b-88b0-95c8337fb492]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8594827-04cd-4066-87e4-c71f173c04b9]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] SCSI volumes sde have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[00204b2a-eef0-47c9-8433-459cd32baaf3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'flavor' on Instance uuid 62d7a041-871d-458f-8de8-db7a53813244 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[125f0965-b6a8-49b9-8cb2-1b9e55ea0bd5]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003, portal: 172.16.0.220,3260]
Nov 14 20:57:14 user nova-compute[76442]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003, portal: 172.16.0.220,3260] successful.
Nov 14 20:57:14 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a3692698-2c5f-422d-9df7-5e971144eaf8 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.609s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.484s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:14 user nova-compute[76442]: INFO nova.compute.manager [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Terminating instance
Nov 14 20:57:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a6de7fc-fe80-47d4-95b6-092376116003 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d794c18-29f1-4acf-bf1d-7f2d813cc76e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] <== disconnect_volume: return (301ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-3fed0a37-15a9-4348-a12b-7d5bbbbae712 req-4d13519a-53e0-4315-b572-bf0eb31e9fe8 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received event network-vif-unplugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3fed0a37-15a9-4348-a12b-7d5bbbbae712 req-4d13519a-53e0-4315-b572-bf0eb31e9fe8 service nova] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3fed0a37-15a9-4348-a12b-7d5bbbbae712 req-4d13519a-53e0-4315-b572-bf0eb31e9fe8 service nova] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3fed0a37-15a9-4348-a12b-7d5bbbbae712 req-4d13519a-53e0-4315-b572-bf0eb31e9fe8 service nova] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-3fed0a37-15a9-4348-a12b-7d5bbbbae712 req-4d13519a-53e0-4315-b572-bf0eb31e9fe8 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] No waiting events found dispatching network-vif-unplugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:57:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-3fed0a37-15a9-4348-a12b-7d5bbbbae712 req-4d13519a-53e0-4315-b572-bf0eb31e9fe8 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received event network-vif-unplugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:57:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Instance destroyed successfully.
Nov 14 20:57:15 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lazy-loading 'resources' on Instance uuid 62d7a041-871d-458f-8de8-db7a53813244 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG nova.objects.instance [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'flavor' on Instance uuid 72f09c08-c10c-4449-941f-4dd5c9737d43 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:54:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1608034560',display_name='tempest-VolumesSnapshotTestJSON-instance-1608034560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1608034560',id=39,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOAUVGF8CseA3SKzZYX0u4K1ChhAaioAvznV5SlzDy4TJz2mXeAWrTHT1TksCOJo3Edlq+BFYVfpr426w6ujEK/xmvbo/xjsGJ71z4wI7BBH9o/BK7R+uQLMovy5zdTTw==',key_name='tempest-keypair-1084862179',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23ecfb771a114113bdcdf1881fcb5f62',ramdisk_id='',reservation_id='r-a62newqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1708796007',owner_user_name='tempest-VolumesSnapshotTestJSON-1708796007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d972568e27ee4a838e978c8d220699f0',uuid=62d7a041-871d-458f-8de8-db7a53813244,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converting VIF {"id": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "address": "fa:16:3e:0e:8c:1e", "network": {"id": "d59cef0d-5353-4a49-bb34-ddce35223f50", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2034917155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ecfb771a114113bdcdf1881fcb5f62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e29f03d-f3", "ovs_interfaceid": "6e29f03d-f3ce-4c1a-9081-d37d3fe235ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:8c:1e,bridge_name='br-int',has_traffic_filtering=True,id=6e29f03d-f3ce-4c1a-9081-d37d3fe235ab,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e29f03d-f3') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_vif [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:8c:1e,bridge_name='br-int',has_traffic_filtering=True,id=6e29f03d-f3ce-4c1a-9081-d37d3fe235ab,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e29f03d-f3') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e29f03d-f3, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d22355a-de79-4e0a-b3ad-63b5670b3065) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:15 user nova-compute[76442]: INFO os_vif [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:8c:1e,bridge_name='br-int',has_traffic_filtering=True,id=6e29f03d-f3ce-4c1a-9081-d37d3fe235ab,network=Network(d59cef0d-5353-4a49-bb34-ddce35223f50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e29f03d-f3')
Nov 14 20:57:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLHUaSMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:57:15 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-be217103-edd1-41e5-9d9f-2d15be27982d tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8991549-863b-429e-a588-ea761553f77e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:57:15 user nova-compute[76442]: No targets found.
Nov 14 20:57:15 user nova-compute[76442]: iSNS:
Nov 14 20:57:15 user nova-compute[76442]: No targets found.
Nov 14 20:57:15 user nova-compute[76442]: STATIC:
Nov 14 20:57:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229
Nov 14 20:57:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917
Nov 14 20:57:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:57:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:57:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:57:15 user nova-compute[76442]: FIRMWARE:
Nov 14 20:57:15 user nova-compute[76442]: No targets found.
Nov 14 20:57:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:57:15 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:57:15 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e45077-f9ef-4d96-a119-94bfb44243ca', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6e3f67-f962-4804-9190-1c9a8835fe71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bae0c4-985b-4fac-b85a-af1364ba9b15]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:57:15 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:57:15 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:57:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:57:15 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:57:15 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:57:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4d24310>, {}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Disconnecting from: [] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] <== disconnect_volume: return (84ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:57:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Deleting instance files /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244_del
Nov 14 20:57:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Deletion of /opt/stack/data/nova/instances/62d7a041-871d-458f-8de8-db7a53813244_del complete
Nov 14 20:57:15 user nova-compute[76442]: INFO nova.compute.manager [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 62d7a041-871d-458f-8de8-db7a53813244] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:57:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:57:16 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Took 0.93 seconds to deallocate network for instance.
Nov 14 20:57:16 user nova-compute[76442]: WARNING nova.volume.cinder [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Attachment 970adc6c-f687-4701-98ee-449b2429d756 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 970adc6c-f687-4701-98ee-449b2429d756. (HTTP 404) (Request-ID: req-767a6b49-f8a3-4ed5-9234-ef8f48e468cf)
Nov 14 20:57:16 user nova-compute[76442]: INFO nova.compute.manager [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 20:57:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-6c18934c-bc4d-433f-bc20-4a0512527a41 req-1b64d08d-facb-4dd6-a77b-4eeab613862c service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received event network-vif-deleted-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:16 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Deleted allocations for instance 62d7a041-871d-458f-8de8-db7a53813244
Nov 14 20:57:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-15fd06b5-2d38-413e-a706-2f310ad05183 req-5fc6ff76-13c9-4b42-8bfc-ac8f8bb33d62 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received event network-vif-plugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-15fd06b5-2d38-413e-a706-2f310ad05183 req-5fc6ff76-13c9-4b42-8bfc-ac8f8bb33d62 service nova] Acquiring lock "62d7a041-871d-458f-8de8-db7a53813244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-15fd06b5-2d38-413e-a706-2f310ad05183 req-5fc6ff76-13c9-4b42-8bfc-ac8f8bb33d62 service nova] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-15fd06b5-2d38-413e-a706-2f310ad05183 req-5fc6ff76-13c9-4b42-8bfc-ac8f8bb33d62 service nova] Lock "62d7a041-871d-458f-8de8-db7a53813244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-15fd06b5-2d38-413e-a706-2f310ad05183 req-5fc6ff76-13c9-4b42-8bfc-ac8f8bb33d62 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] No waiting events found dispatching network-vif-plugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:57:16 user nova-compute[76442]: WARNING nova.compute.manager [req-15fd06b5-2d38-413e-a706-2f310ad05183 req-5fc6ff76-13c9-4b42-8bfc-ac8f8bb33d62 service nova] [instance: 62d7a041-871d-458f-8de8-db7a53813244] Received unexpected event network-vif-plugged-6e29f03d-f3ce-4c1a-9081-d37d3fe235ab for instance with vm_state deleted and task_state None.
Nov 14 20:57:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0d6a1026-5db4-4056-a1c6-3921bcc94963 tempest-VolumesSnapshotTestJSON-1708796007 tempest-VolumesSnapshotTestJSON-1708796007-project-member] Lock "62d7a041-871d-458f-8de8-db7a53813244" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.338s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:57:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:57:19 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:57:19 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8277MB free_disk=25.202007293701172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 211f5689-1c50-4638-a3e4-deeafc6013cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 72f09c08-c10c-4449-941f-4dd5c9737d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 89d63489-51be-4620-ae51-c5a84a14ccfe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:57:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updating instance_info_cache with network_info: [{"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-e62b2506-c519-49bd-a678-0da035a6b1a9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:57:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:57:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:57:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 20:57:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:57:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:57:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-fc59b8c4-3d38-4da6-965f-81113462343d req-e1a70290-ec09-444c-ab66-4b93215181df service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:57:40 user nova-compute[76442]: DEBUG nova.compute.manager [req-fc59b8c4-3d38-4da6-965f-81113462343d req-e1a70290-ec09-444c-ab66-4b93215181df service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing instance network info cache due to event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:57:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fc59b8c4-3d38-4da6-965f-81113462343d req-e1a70290-ec09-444c-ab66-4b93215181df service nova] Acquiring lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:57:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fc59b8c4-3d38-4da6-965f-81113462343d req-e1a70290-ec09-444c-ab66-4b93215181df service nova] Acquired lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:57:40 user nova-compute[76442]: DEBUG nova.network.neutron [req-fc59b8c4-3d38-4da6-965f-81113462343d req-e1a70290-ec09-444c-ab66-4b93215181df service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:57:40 user nova-compute[76442]: DEBUG nova.network.neutron [req-fc59b8c4-3d38-4da6-965f-81113462343d req-e1a70290-ec09-444c-ab66-4b93215181df service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updated VIF entry in instance network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:57:40 user nova-compute[76442]: DEBUG nova.network.neutron [req-fc59b8c4-3d38-4da6-965f-81113462343d req-e1a70290-ec09-444c-ab66-4b93215181df service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating instance_info_cache with network_info: [{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:57:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-fc59b8c4-3d38-4da6-965f-81113462343d req-e1a70290-ec09-444c-ab66-4b93215181df service nova] Releasing lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG nova.compute.manager [req-467e2206-1937-455a-851f-8449c5bb8226 req-70d355ec-335b-420b-9309-e27c2217f998 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG nova.compute.manager [req-467e2206-1937-455a-851f-8449c5bb8226 req-70d355ec-335b-420b-9309-e27c2217f998 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing instance network info cache due to event network-changed-0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-467e2206-1937-455a-851f-8449c5bb8226 req-70d355ec-335b-420b-9309-e27c2217f998 service nova] Acquiring lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-467e2206-1937-455a-851f-8449c5bb8226 req-70d355ec-335b-420b-9309-e27c2217f998 service nova] Acquired lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG nova.network.neutron [req-467e2206-1937-455a-851f-8449c5bb8226 req-70d355ec-335b-420b-9309-e27c2217f998 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Refreshing network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:41 user nova-compute[76442]: INFO nova.compute.manager [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Detaching volume c915f799-42d0-4f0a-ba46-2b7621e57917
Nov 14 20:57:41 user nova-compute[76442]: INFO nova.virt.block_device [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Attempting to driver detach volume c915f799-42d0-4f0a-ba46-2b7621e57917 from mountpoint /dev/vdb
Nov 14 20:57:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Attempting to detach device vdb from instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:57:41 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:57:41 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 20:57:41 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:57:41 user nova-compute[76442]:   <serial>c915f799-42d0-4f0a-ba46-2b7621e57917</serial>
Nov 14 20:57:41 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:57:41 user nova-compute[76442]: </disk>
Nov 14 20:57:41 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:57:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully detached device vdb from instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 from the persistent domain config.
Nov 14 20:57:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:57:41 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:57:41 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 20:57:41 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:57:41 user nova-compute[76442]:   <serial>c915f799-42d0-4f0a-ba46-2b7621e57917</serial>
Nov 14 20:57:41 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:57:41 user nova-compute[76442]: </disk>
Nov 14 20:57:41 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG nova.network.neutron [req-467e2206-1937-455a-851f-8449c5bb8226 req-70d355ec-335b-420b-9309-e27c2217f998 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updated VIF entry in instance network info cache for port 0356fbfc-6a6d-4f06-b191-f2dd7d056d86. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG nova.network.neutron [req-467e2206-1937-455a-851f-8449c5bb8226 req-70d355ec-335b-420b-9309-e27c2217f998 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating instance_info_cache with network_info: [{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:57:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-467e2206-1937-455a-851f-8449c5bb8226 req-70d355ec-335b-420b-9309-e27c2217f998 service nova] Releasing lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:57:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:57:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:57:46 user nova-compute[76442]: INFO nova.compute.manager [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] instance snapshotting
Nov 14 20:57:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Beginning live snapshot process
Nov 14 20:57:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json -f qcow2 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json -f qcow2 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps0s9cv7p/5cccbb28eb8b4372bd052e949f19cfb6.delta 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps0s9cv7p/5cccbb28eb8b4372bd052e949f19cfb6.delta 1073741824" returned: 0 in 0.056s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:46 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 20:57:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:57:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=76442) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 20:57:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 20:57:48 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:57:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps0s9cv7p/5cccbb28eb8b4372bd052e949f19cfb6.delta /opt/stack/data/nova/instances/snapshots/tmps0s9cv7p/5cccbb28eb8b4372bd052e949f19cfb6 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps0s9cv7p/5cccbb28eb8b4372bd052e949f19cfb6.delta /opt/stack/data/nova/instances/snapshots/tmps0s9cv7p/5cccbb28eb8b4372bd052e949f19cfb6" returned: 0 in 0.447s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Snapshot extracted, beginning image upload
Nov 14 20:57:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:57:51 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Snapshot image upload complete
Nov 14 20:57:51 user nova-compute[76442]: INFO nova.compute.manager [None req-60c25e27-7183-4af3-bef0-499dec1a1c3a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Took 5.85 seconds to snapshot the instance on the hypervisor.
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:57:54 user nova-compute[76442]: INFO nova.compute.claims [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Claim successful on node user
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:57:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.policy [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64183849e82a427ea2e034ad39c70374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7ef39084aa4d8faaeb192c1eaf6874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:57:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Creating image(s)
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "/opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "/opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "/opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "3189bbccb258345605ee17c3bdc44d3b13d135bd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "3189bbccb258345605ee17c3bdc44d3b13d135bd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:55 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Successfully created port: 2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:57:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd.part --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:55 user nova-compute[76442]: DEBUG nova.virt.images [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] e1c1cfad-0045-4bbf-a983-9f55e13c959f was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 20:57:55 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 20:57:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd.part /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd.part /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd.converted" returned: 0 in 0.283s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "3189bbccb258345605ee17c3bdc44d3b13d135bd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.626s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "3189bbccb258345605ee17c3bdc44d3b13d135bd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "3189bbccb258345605ee17c3bdc44d3b13d135bd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd,backing_fmt=raw /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd,backing_fmt=raw /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk 1073741824" returned: 0 in 0.053s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "3189bbccb258345605ee17c3bdc44d3b13d135bd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Successfully updated port: 2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquired lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-84845a43-898e-45c4-b964-9f073b221804 req-992edf3e-1093-4d0c-ad4d-81034a41c5a1 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received event network-changed-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-84845a43-898e-45c4-b964-9f073b221804 req-992edf3e-1093-4d0c-ad4d-81034a41c5a1 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Refreshing instance network info cache due to event network-changed-2843808a-ae7c-4a4d-a5bc-6909cb148cc6. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-84845a43-898e-45c4-b964-9f073b221804 req-992edf3e-1093-4d0c-ad4d-81034a41c5a1 service nova] Acquiring lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:57:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Ensure instance console log exists: /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Updating instance_info_cache with network_info: [{"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Releasing lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Instance network_info: |[{"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-84845a43-898e-45c4-b964-9f073b221804 req-992edf3e-1093-4d0c-ad4d-81034a41c5a1 service nova] Acquired lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-84845a43-898e-45c4-b964-9f073b221804 req-992edf3e-1093-4d0c-ad4d-81034a41c5a1 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Refreshing network info cache for port 2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Start _get_guest_xml network_info=[{"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='487d809b23cf5b7b15c801d570ea9265',container_format='bare',created_at=2023-11-14T20:57:46Z,direct_url=<?>,disk_format='qcow2',id=e1c1cfad-0045-4bbf-a983-9f55e13c959f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1218681923',owner='1b7ef39084aa4d8faaeb192c1eaf6874',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T20:57:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'e1c1cfad-0045-4bbf-a983-9f55e13c959f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:57:57 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:57:57 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='487d809b23cf5b7b15c801d570ea9265',container_format='bare',created_at=2023-11-14T20:57:46Z,direct_url=<?>,disk_format='qcow2',id=e1c1cfad-0045-4bbf-a983-9f55e13c959f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1218681923',owner='1b7ef39084aa4d8faaeb192c1eaf6874',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T20:57:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-622058940',display_name='tempest-TestStampPattern-server-622058940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-622058940',id=42,image_ref='e1c1cfad-0045-4bbf-a983-9f55e13c959f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvdINDy4N0nCmsxw9+z0YuoH3ORFDVbievK0y+5u+iZAsq6JkSs0vSSkOTyVGZyPAbS/GlayoYiP7LELDfKg0H397As/3cvk8b3zQIt0rEeH8Jo8IjV+llgBEk0dkVVig==',key_name='tempest-TestStampPattern-1089595662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7ef39084aa4d8faaeb192c1eaf6874',ramdisk_id='',reservation_id='r-e6v0vfnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='72f09c08-c10c-4449-941f-4dd5c9737d43',image_min_disk='1',image_min_ram='0',image_owner_id='1b7ef39084aa4d8faaeb192c1eaf6874',image_owner_project_name='tempest-TestStampPattern-369137228',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-369137228-project-member',image_user_id='64183849e82a427ea2e034ad39c70374',network_allocated='True',owner_project_name='tempest-TestStampPattern-369137228',owner_user_name='tempest-TestStampPattern-369137228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:57:55Z,user_data=None,user_id='64183849e82a427ea2e034ad39c70374',uuid=363657a6-e0d6-4f1b-97be-f5f936a2479c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converting VIF {"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:1e,bridge_name='br-int',has_traffic_filtering=True,id=2843808a-ae7c-4a4d-a5bc-6909cb148cc6,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2843808a-ae') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.objects.instance [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'pci_devices' on Instance uuid 363657a6-e0d6-4f1b-97be-f5f936a2479c {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:57:57 user nova-compute[76442]:   <uuid>363657a6-e0d6-4f1b-97be-f5f936a2479c</uuid>
Nov 14 20:57:57 user nova-compute[76442]:   <name>instance-0000002a</name>
Nov 14 20:57:57 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:57:57 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:57:57 user nova-compute[76442]:   <metadata>
Nov 14 20:57:57 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:57:57 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:57:57 user nova-compute[76442]:       <nova:name>tempest-TestStampPattern-server-622058940</nova:name>
Nov 14 20:57:57 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:57:57</nova:creationTime>
Nov 14 20:57:57 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:57:57 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:57:57 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:57:57 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:57:57 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:57:57 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:57:57 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:57:57 user nova-compute[76442]:       <nova:owner>
Nov 14 20:57:57 user nova-compute[76442]:         <nova:user uuid="64183849e82a427ea2e034ad39c70374">tempest-TestStampPattern-369137228-project-member</nova:user>
Nov 14 20:57:57 user nova-compute[76442]:         <nova:project uuid="1b7ef39084aa4d8faaeb192c1eaf6874">tempest-TestStampPattern-369137228</nova:project>
Nov 14 20:57:57 user nova-compute[76442]:       </nova:owner>
Nov 14 20:57:57 user nova-compute[76442]:       <nova:root type="image" uuid="e1c1cfad-0045-4bbf-a983-9f55e13c959f"/>
Nov 14 20:57:57 user nova-compute[76442]:       <nova:ports>
Nov 14 20:57:57 user nova-compute[76442]:         <nova:port uuid="2843808a-ae7c-4a4d-a5bc-6909cb148cc6">
Nov 14 20:57:57 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 20:57:57 user nova-compute[76442]:         </nova:port>
Nov 14 20:57:57 user nova-compute[76442]:       </nova:ports>
Nov 14 20:57:57 user nova-compute[76442]:     </nova:instance>
Nov 14 20:57:57 user nova-compute[76442]:   </metadata>
Nov 14 20:57:57 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:57:57 user nova-compute[76442]:     <system>
Nov 14 20:57:57 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:57:57 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:57:57 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:57:57 user nova-compute[76442]:       <entry name="serial">363657a6-e0d6-4f1b-97be-f5f936a2479c</entry>
Nov 14 20:57:57 user nova-compute[76442]:       <entry name="uuid">363657a6-e0d6-4f1b-97be-f5f936a2479c</entry>
Nov 14 20:57:57 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:57:57 user nova-compute[76442]:     </system>
Nov 14 20:57:57 user nova-compute[76442]:   </sysinfo>
Nov 14 20:57:57 user nova-compute[76442]:   <os>
Nov 14 20:57:57 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:57:57 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:57:57 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:57:57 user nova-compute[76442]:   </os>
Nov 14 20:57:57 user nova-compute[76442]:   <features>
Nov 14 20:57:57 user nova-compute[76442]:     <acpi/>
Nov 14 20:57:57 user nova-compute[76442]:     <apic/>
Nov 14 20:57:57 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:57:57 user nova-compute[76442]:   </features>
Nov 14 20:57:57 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:57:57 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:57:57 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:57:57 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:57:57 user nova-compute[76442]:   </clock>
Nov 14 20:57:57 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:57:57 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:57:57 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:57:57 user nova-compute[76442]:   </cpu>
Nov 14 20:57:57 user nova-compute[76442]:   <devices>
Nov 14 20:57:57 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:57:57 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:57:57 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk"/>
Nov 14 20:57:57 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:57:57 user nova-compute[76442]:     </disk>
Nov 14 20:57:57 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:57:57 user nova-compute[76442]:       <mac address="fa:16:3e:22:5c:1e"/>
Nov 14 20:57:57 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:57:57 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:57:57 user nova-compute[76442]:       <target dev="tap2843808a-ae"/>
Nov 14 20:57:57 user nova-compute[76442]:     </interface>
Nov 14 20:57:57 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:57:57 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/console.log" append="off"/>
Nov 14 20:57:57 user nova-compute[76442]:     </serial>
Nov 14 20:57:57 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:57:57 user nova-compute[76442]:     <video>
Nov 14 20:57:57 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:57:57 user nova-compute[76442]:     </video>
Nov 14 20:57:57 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:57:57 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:57:57 user nova-compute[76442]:     </rng>
Nov 14 20:57:57 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:57:57 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:57:57 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:57:57 user nova-compute[76442]:     </memballoon>
Nov 14 20:57:57 user nova-compute[76442]:   </devices>
Nov 14 20:57:57 user nova-compute[76442]: </domain>
Nov 14 20:57:57 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-622058940',display_name='tempest-TestStampPattern-server-622058940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-622058940',id=42,image_ref='e1c1cfad-0045-4bbf-a983-9f55e13c959f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvdINDy4N0nCmsxw9+z0YuoH3ORFDVbievK0y+5u+iZAsq6JkSs0vSSkOTyVGZyPAbS/GlayoYiP7LELDfKg0H397As/3cvk8b3zQIt0rEeH8Jo8IjV+llgBEk0dkVVig==',key_name='tempest-TestStampPattern-1089595662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b7ef39084aa4d8faaeb192c1eaf6874',ramdisk_id='',reservation_id='r-e6v0vfnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='72f09c08-c10c-4449-941f-4dd5c9737d43',image_min_disk='1',image_min_ram='0',image_owner_id='1b7ef39084aa4d8faaeb192c1eaf6874',image_owner_project_name='tempest-TestStampPattern-369137228',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-369137228-project-member',image_user_id='64183849e82a427ea2e034ad39c70374',network_allocated='True',owner_project_name='tempest-TestStampPattern-369137228',owner_user_name='tempest-TestStampPattern-369137228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:57:55Z,user_data=None,user_id='64183849e82a427ea2e034ad39c70374',uuid=363657a6-e0d6-4f1b-97be-f5f936a2479c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converting VIF {"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:1e,bridge_name='br-int',has_traffic_filtering=True,id=2843808a-ae7c-4a4d-a5bc-6909cb148cc6,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2843808a-ae') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG os_vif [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:1e,bridge_name='br-int',has_traffic_filtering=True,id=2843808a-ae7c-4a4d-a5bc-6909cb148cc6,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2843808a-ae') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd3dc609-95a4-5392-9149-c36b36341615', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2843808a-ae, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2843808a-ae, col_values=(('qos', UUID('57ff79bf-772d-481f-8f59-761f292ed203')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2843808a-ae, col_values=(('external_ids', {'iface-id': '2843808a-ae7c-4a4d-a5bc-6909cb148cc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:5c:1e', 'vm-uuid': '363657a6-e0d6-4f1b-97be-f5f936a2479c'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:57 user nova-compute[76442]: INFO os_vif [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:5c:1e,bridge_name='br-int',has_traffic_filtering=True,id=2843808a-ae7c-4a4d-a5bc-6909cb148cc6,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2843808a-ae')
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No VIF found with MAC fa:16:3e:22:5c:1e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-84845a43-898e-45c4-b964-9f073b221804 req-992edf3e-1093-4d0c-ad4d-81034a41c5a1 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Updated VIF entry in instance network info cache for port 2843808a-ae7c-4a4d-a5bc-6909cb148cc6. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG nova.network.neutron [req-84845a43-898e-45c4-b964-9f073b221804 req-992edf3e-1093-4d0c-ad4d-81034a41c5a1 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Updating instance_info_cache with network_info: [{"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:57:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-84845a43-898e-45c4-b964-9f073b221804 req-992edf3e-1093-4d0c-ad4d-81034a41c5a1 service nova] Releasing lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:57:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-df65f283-e677-4d94-a16a-f9c8e08c2b55 req-1f4daf13-73df-4d64-9885-8ffb43b9de6b service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received event network-vif-plugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:57:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-df65f283-e677-4d94-a16a-f9c8e08c2b55 req-1f4daf13-73df-4d64-9885-8ffb43b9de6b service nova] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-df65f283-e677-4d94-a16a-f9c8e08c2b55 req-1f4daf13-73df-4d64-9885-8ffb43b9de6b service nova] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-df65f283-e677-4d94-a16a-f9c8e08c2b55 req-1f4daf13-73df-4d64-9885-8ffb43b9de6b service nova] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-df65f283-e677-4d94-a16a-f9c8e08c2b55 req-1f4daf13-73df-4d64-9885-8ffb43b9de6b service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] No waiting events found dispatching network-vif-plugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:57:58 user nova-compute[76442]: WARNING nova.compute.manager [req-df65f283-e677-4d94-a16a-f9c8e08c2b55 req-1f4daf13-73df-4d64-9885-8ffb43b9de6b service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received unexpected event network-vif-plugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 for instance with vm_state building and task_state spawning.
Nov 14 20:57:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:57:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:57:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:57:59 user nova-compute[76442]: INFO nova.compute.manager [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Terminating instance
Nov 14 20:57:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:57:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:57:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-066f62c6-b727-4e53-ba6b-6ef95d9b2559 req-76a99cff-7f7b-4889-a721-03943b394275 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-unplugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-066f62c6-b727-4e53-ba6b-6ef95d9b2559 req-76a99cff-7f7b-4889-a721-03943b394275 service nova] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-066f62c6-b727-4e53-ba6b-6ef95d9b2559 req-76a99cff-7f7b-4889-a721-03943b394275 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-066f62c6-b727-4e53-ba6b-6ef95d9b2559 req-76a99cff-7f7b-4889-a721-03943b394275 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-066f62c6-b727-4e53-ba6b-6ef95d9b2559 req-76a99cff-7f7b-4889-a721-03943b394275 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] No waiting events found dispatching network-vif-unplugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.compute.manager [req-066f62c6-b727-4e53-ba6b-6ef95d9b2559 req-76a99cff-7f7b-4889-a721-03943b394275 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-unplugged-4059beb2-3592-4674-998b-eebf79ea5939 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:00 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Instance destroyed successfully.
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.objects.instance [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'resources' on Instance uuid 211f5689-1c50-4638-a3e4-deeafc6013cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:51:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-152620928',display_name='tempest-ServerActionsTestOtherA-server-152620928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-152620928',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoMdApy2/8RPeA4MJeY2Nu8Fs1E5GIuT9rjXghW7E9nGEEJp3g35T0Y9hTYfuPiIewBxyfqXb2Q0ojDzSguW+OQkINVwKKH0JhOm94wxqmTbduWYc6NzfRIomyekkQ6+w==',key_name='tempest-keypair-553797527',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:53:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-npnxfbzv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=211f5689-1c50-4638-a3e4-deeafc6013cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "4059beb2-3592-4674-998b-eebf79ea5939", "address": "fa:16:3e:5f:c9:a7", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4059beb2-35", "ovs_interfaceid": "4059beb2-3592-4674-998b-eebf79ea5939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_vif [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4059beb2-35, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f6d1023-e7e5-4bd9-b0a9-cb8e3148d130) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:58:00 user nova-compute[76442]: INFO os_vif [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:c9:a7,bridge_name='br-int',has_traffic_filtering=True,id=4059beb2-3592-4674-998b-eebf79ea5939,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4059beb2-35')
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oEHtinmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:58:00 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[88851929-ca94-4b86-9a7e-a73581a66819]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:58:00 user nova-compute[76442]: No targets found.
Nov 14 20:58:00 user nova-compute[76442]: iSNS:
Nov 14 20:58:00 user nova-compute[76442]: No targets found.
Nov 14 20:58:00 user nova-compute[76442]: STATIC:
Nov 14 20:58:00 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229
Nov 14 20:58:00 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:58:00 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:58:00 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917
Nov 14 20:58:00 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:58:00 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:58:00 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe
Nov 14 20:58:00 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:58:00 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:58:00 user nova-compute[76442]: FIRMWARE:
Nov 14 20:58:00 user nova-compute[76442]: No targets found.
Nov 14 20:58:00 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:58:00 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:58:00 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[65788390-6c3c-4fb8-9a89-86bb9242984f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[51290416-0591-4e39-a3bd-fe99d8014c90]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:58:00 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:58:00 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:58:00 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe (non-flash)
Nov 14 20:58:00 user nova-compute[76442]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:58:00 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:58:00 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4d27b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe'): ({'sdf'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Removing single pathed devices sdf {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3490453f-6f65-4aeb-b7c4-fca9402668f4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff2bb66-f49c-436b-bd6e-cb05553ca8d4]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Flushing IO for device /dev/sdf {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9713cd7d-43eb-4e9d-af67-74cba68c3b11]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.066s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18270c2-ece9-486e-aacf-3bbc03a3486f]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] SCSI volumes sdf have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44d9191-6477-4c9b-9f84-a44c4638c4d7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:58:00 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Instance spawned successfully.
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e249a6aa-f724-4234-8574-cadf80a51ab7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260]
Nov 14 20:58:00 user nova-compute[76442]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe, portal: 172.16.0.220,3260] successful.
Nov 14 20:58:00 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:58:00 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9edb99-0c95-417a-938d-8a2a0353d6fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[649b13e1-90d7-470f-a4bb-cdf22bdb369c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] <== disconnect_volume: return (351ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:58:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Deleting instance files /opt/stack/data/nova/instances/211f5689-1c50-4638-a3e4-deeafc6013cc_del
Nov 14 20:58:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Deletion of /opt/stack/data/nova/instances/211f5689-1c50-4638-a3e4-deeafc6013cc_del complete
Nov 14 20:58:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-e58870e7-0782-4d82-9e61-653c8049ea31 req-20f3d77b-890e-499f-898e-7e333786afd9 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received event network-vif-plugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e58870e7-0782-4d82-9e61-653c8049ea31 req-20f3d77b-890e-499f-898e-7e333786afd9 service nova] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e58870e7-0782-4d82-9e61-653c8049ea31 req-20f3d77b-890e-499f-898e-7e333786afd9 service nova] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e58870e7-0782-4d82-9e61-653c8049ea31 req-20f3d77b-890e-499f-898e-7e333786afd9 service nova] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG nova.compute.manager [req-e58870e7-0782-4d82-9e61-653c8049ea31 req-20f3d77b-890e-499f-898e-7e333786afd9 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] No waiting events found dispatching network-vif-plugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:01 user nova-compute[76442]: WARNING nova.compute.manager [req-e58870e7-0782-4d82-9e61-653c8049ea31 req-20f3d77b-890e-499f-898e-7e333786afd9 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received unexpected event network-vif-plugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 for instance with vm_state building and task_state spawning.
Nov 14 20:58:01 user nova-compute[76442]: INFO nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 14 20:58:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:58:01 user nova-compute[76442]: INFO nova.compute.manager [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 20:58:01 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:58:01 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:58:01 user nova-compute[76442]: INFO nova.compute.manager [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Took 7.04 seconds to build instance.
Nov 14 20:58:01 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-a83ceb7f-233d-4eef-b1a2-3ef3844fa593 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.170s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:02 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 is timed out.
Nov 14 20:58:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully detached device vdb from instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 from the live domain config.
Nov 14 20:58:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJdQeSbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:58:02 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcbf581-cbe2-4151-9f61-ecaf153eb4b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:58:02 user nova-compute[76442]: No targets found.
Nov 14 20:58:02 user nova-compute[76442]: iSNS:
Nov 14 20:58:02 user nova-compute[76442]: No targets found.
Nov 14 20:58:02 user nova-compute[76442]: STATIC:
Nov 14 20:58:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229
Nov 14 20:58:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:58:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:58:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917
Nov 14 20:58:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:58:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:58:02 user nova-compute[76442]: FIRMWARE:
Nov 14 20:58:02 user nova-compute[76442]: No targets found.
Nov 14 20:58:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:58:02 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:58:02 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2566316e-1d8d-4a7b-ba81-1242ab7e91df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2905b4-89f0-44a3-ab3c-53fb691b948f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:58:02 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:58:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 (non-flash)
Nov 14 20:58:02 user nova-compute[76442]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:58:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e85e4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-0511edbf-1d26-40f6-95b6-87f87eef7162 req-2e03fdcc-3157-4c28-b1d5-a829f4cfd4f2 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0511edbf-1d26-40f6-95b6-87f87eef7162 req-2e03fdcc-3157-4c28-b1d5-a829f4cfd4f2 service nova] Acquiring lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0511edbf-1d26-40f6-95b6-87f87eef7162 req-2e03fdcc-3157-4c28-b1d5-a829f4cfd4f2 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0511edbf-1d26-40f6-95b6-87f87eef7162 req-2e03fdcc-3157-4c28-b1d5-a829f4cfd4f2 service nova] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-0511edbf-1d26-40f6-95b6-87f87eef7162 req-2e03fdcc-3157-4c28-b1d5-a829f4cfd4f2 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] No waiting events found dispatching network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:02 user nova-compute[76442]: WARNING nova.compute.manager [req-0511edbf-1d26-40f6-95b6-87f87eef7162 req-2e03fdcc-3157-4c28-b1d5-a829f4cfd4f2 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received unexpected event network-vif-plugged-4059beb2-3592-4674-998b-eebf79ea5939 for instance with vm_state active and task_state deleting.
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f45a5b3-da1b-43ce-87c5-40c1fe756db9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57eceee-600a-4d3c-b8b1-f566a4ed70ba]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Took 1.17 seconds to deallocate network for instance.
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bb28a9-6c36-44e6-9cbb-39e68b4e01bb]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc668ba-2f2c-4896-b31c-c3c0e94ee0c1]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9f6524-528b-45a2-a5af-54126474f35d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a337c5d-1b34-442d-b4f3-3669b650031c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917, portal: 172.16.0.220,3260]
Nov 14 20:58:02 user nova-compute[76442]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917, portal: 172.16.0.220,3260] successful.
Nov 14 20:58:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c915f799-42d0-4f0a-ba46-2b7621e57917 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f38a122-a1aa-44dc-8a00-b37b7ed9381c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] <== disconnect_volume: return (385ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:03 user nova-compute[76442]: DEBUG nova.compute.manager [req-b63b817e-709f-4117-8f9c-3fdf38a8e69f req-b4ef7abe-fa2d-4df1-bd44-e3541c8d64e9 service nova] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Received event network-vif-deleted-4059beb2-3592-4674-998b-eebf79ea5939 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:03 user nova-compute[76442]: INFO nova.compute.manager [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Took 0.83 seconds to detach 1 volumes for instance.
Nov 14 20:58:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: 211f5689-1c50-4638-a3e4-deeafc6013cc] Deleting volume: 6a9edb99-0c95-417a-938d-8a2a0353d6fe {{(pid=76442) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 20:58:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:03 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:58:03 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:58:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:03 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Deleted allocations for instance 211f5689-1c50-4638-a3e4-deeafc6013cc
Nov 14 20:58:03 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'flavor' on Instance uuid f372cd49-b14f-49ae-9ffe-722822ae4ad9 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:58:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fbe3b666-ced2-4dd3-b301-6137a6d528cf tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "211f5689-1c50-4638-a3e4-deeafc6013cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.828s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5e9488ef-78d7-43e3-86bb-cf1502dffbbd tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.175s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:12 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:58:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:58:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:58:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:58:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:19 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:20 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 20:58:21 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:58:21 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8289MB free_disk=25.04416275024414GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance e62b2506-c519-49bd-a678-0da035a6b1a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance f372cd49-b14f-49ae-9ffe-722822ae4ad9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 72f09c08-c10c-4449-941f-4dd5c9737d43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 89d63489-51be-4620-ae51-c5a84a14ccfe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 363657a6-e0d6-4f1b-97be-f5f936a2479c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:58:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:58:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:58:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:58:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:58:23 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:58:23 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating instance_info_cache with network_info: [{"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:58:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-f372cd49-b14f-49ae-9ffe-722822ae4ad9" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:58:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:58:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:58:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:58:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "89d63489-51be-4620-ae51-c5a84a14ccfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:26 user nova-compute[76442]: INFO nova.compute.manager [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Terminating instance
Nov 14 20:58:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-f997c637-0eee-4b3d-a15b-55bf46c50c37 req-15190e0d-b7be-46bb-9900-e3d6fe052d54 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received event network-vif-unplugged-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f997c637-0eee-4b3d-a15b-55bf46c50c37 req-15190e0d-b7be-46bb-9900-e3d6fe052d54 service nova] Acquiring lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f997c637-0eee-4b3d-a15b-55bf46c50c37 req-15190e0d-b7be-46bb-9900-e3d6fe052d54 service nova] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f997c637-0eee-4b3d-a15b-55bf46c50c37 req-15190e0d-b7be-46bb-9900-e3d6fe052d54 service nova] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-f997c637-0eee-4b3d-a15b-55bf46c50c37 req-15190e0d-b7be-46bb-9900-e3d6fe052d54 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] No waiting events found dispatching network-vif-unplugged-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-f997c637-0eee-4b3d-a15b-55bf46c50c37 req-15190e0d-b7be-46bb-9900-e3d6fe052d54 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received event network-vif-unplugged-767a93be-e47f-4671-ac34-175f45a94fe7 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:58:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Instance destroyed successfully.
Nov 14 20:58:26 user nova-compute[76442]: DEBUG nova.objects.instance [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'resources' on Instance uuid 89d63489-51be-4620-ae51-c5a84a14ccfe {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-176601727',display_name='tempest-TestVolumeBootPattern-server-176601727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-176601727',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:56:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-pze5knmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:56:51Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=89d63489-51be-4620-ae51-c5a84a14ccfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "767a93be-e47f-4671-ac34-175f45a94fe7", "address": "fa:16:3e:dd:9b:7b", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767a93be-e4", "ovs_interfaceid": "767a93be-e47f-4671-ac34-175f45a94fe7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=767a93be-e47f-4671-ac34-175f45a94fe7,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767a93be-e4') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_vif [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=767a93be-e47f-4671-ac34-175f45a94fe7,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767a93be-e4') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap767a93be-e4, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2d31ce4-411f-4e35-8d28-5c299a7fdab8) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:26 user nova-compute[76442]: INFO os_vif [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:9b:7b,bridge_name='br-int',has_traffic_filtering=True,id=767a93be-e47f-4671-ac34-175f45a94fe7,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767a93be-e4')
Nov 14 20:58:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VZkgvRDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:58:26 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1b3b49-9fc0-4536-8b30-cfd6c306cd5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 20:58:26 user nova-compute[76442]: No targets found.
Nov 14 20:58:26 user nova-compute[76442]: iSNS:
Nov 14 20:58:26 user nova-compute[76442]: No targets found.
Nov 14 20:58:26 user nova-compute[76442]: STATIC:
Nov 14 20:58:26 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229
Nov 14 20:58:26 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 20:58:26 user nova-compute[76442]:                 Iface Name: default
Nov 14 20:58:26 user nova-compute[76442]: FIRMWARE:
Nov 14 20:58:26 user nova-compute[76442]: No targets found.
Nov 14 20:58:26 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 20:58:26 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 20:58:26 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8aabb9-0992-4e6a-a40d-642adb8c4622]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e051672-bb9a-4338-b8bb-05c25e91b2b2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:58:26 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 (non-flash)
Nov 14 20:58:26 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4e04790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 20:58:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[da27427c-7ada-4aa3-a5ab-94b9c87737d3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[575081a2-8e14-4870-acd8-828900bcfcd2]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.129s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[52520f66-fc15-4006-b5aa-ece0e289f732]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[947c6527-c68d-47de-beda-99daf61ce7df]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23036316139383964', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a1e2fc6b', '/dev/disk/by-id/scsi-1SCST_BIOa1e2fc6b-061a989de9f6f413') {{(pid=87657) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b3f4e1-2fc2-414d-8e68-c0a0dad70da4]: (4, None) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d59fed-f8fa-4b6e-8fef-70620ddf72cf]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bc768b-b2fd-4a45-8e17-eb91ff66e439]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229, portal: 172.16.0.220,3260]
Nov 14 20:58:27 user nova-compute[76442]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229, portal: 172.16.0.220,3260] successful.
Nov 14 20:58:27 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a5a493b-4d85-4612-bc55-36cb35e64229 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc4e94-c820-4b17-a0eb-d7029dcc97a4]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== disconnect_volume: return (445ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 20:58:27 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Deleting instance files /opt/stack/data/nova/instances/89d63489-51be-4620-ae51-c5a84a14ccfe_del
Nov 14 20:58:27 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Deletion of /opt/stack/data/nova/instances/89d63489-51be-4620-ae51-c5a84a14ccfe_del complete
Nov 14 20:58:27 user nova-compute[76442]: INFO nova.compute.manager [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 14 20:58:27 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:58:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:28 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:58:28 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Took 0.91 seconds to deallocate network for instance.
Nov 14 20:58:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-2f730899-8420-4cd7-9e57-fa3d22ce31c7 req-158baadd-10bf-4b1a-948a-1e0dcb7e7006 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received event network-vif-deleted-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:28 user nova-compute[76442]: INFO nova.compute.manager [req-2f730899-8420-4cd7-9e57-fa3d22ce31c7 req-158baadd-10bf-4b1a-948a-1e0dcb7e7006 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Neutron deleted interface 767a93be-e47f-4671-ac34-175f45a94fe7; detaching it from the instance and deleting it from the info cache
Nov 14 20:58:28 user nova-compute[76442]: DEBUG nova.network.neutron [req-2f730899-8420-4cd7-9e57-fa3d22ce31c7 req-158baadd-10bf-4b1a-948a-1e0dcb7e7006 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:58:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-2f730899-8420-4cd7-9e57-fa3d22ce31c7 req-158baadd-10bf-4b1a-948a-1e0dcb7e7006 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Detach interface failed, port_id=767a93be-e47f-4671-ac34-175f45a94fe7, reason: Instance 89d63489-51be-4620-ae51-c5a84a14ccfe could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 20:58:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-dbc36930-c475-4d69-9e09-1d134ca71406 req-5d1099bc-9f02-4a4f-8695-904b4b6f6a31 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received event network-vif-plugged-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dbc36930-c475-4d69-9e09-1d134ca71406 req-5d1099bc-9f02-4a4f-8695-904b4b6f6a31 service nova] Acquiring lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dbc36930-c475-4d69-9e09-1d134ca71406 req-5d1099bc-9f02-4a4f-8695-904b4b6f6a31 service nova] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dbc36930-c475-4d69-9e09-1d134ca71406 req-5d1099bc-9f02-4a4f-8695-904b4b6f6a31 service nova] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-dbc36930-c475-4d69-9e09-1d134ca71406 req-5d1099bc-9f02-4a4f-8695-904b4b6f6a31 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] No waiting events found dispatching network-vif-plugged-767a93be-e47f-4671-ac34-175f45a94fe7 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:28 user nova-compute[76442]: WARNING nova.compute.manager [req-dbc36930-c475-4d69-9e09-1d134ca71406 req-5d1099bc-9f02-4a4f-8695-904b4b6f6a31 service nova] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Received unexpected event network-vif-plugged-767a93be-e47f-4671-ac34-175f45a94fe7 for instance with vm_state active and task_state deleting.
Nov 14 20:58:29 user nova-compute[76442]: INFO nova.compute.manager [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 20:58:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 89d63489-51be-4620-ae51-c5a84a14ccfe] Deleting volume: 7a5a493b-4d85-4612-bc55-36cb35e64229 {{(pid=76442) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 20:58:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:29 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:58:29 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:58:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:29 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Deleted allocations for instance 89d63489-51be-4620-ae51-c5a84a14ccfe
Nov 14 20:58:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ed41d70c-38a1-4182-97f6-237e8da4e941 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "89d63489-51be-4620-ae51-c5a84a14ccfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.459s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:58:30 user nova-compute[76442]: INFO nova.compute.claims [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Claim successful on node user
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:58:30 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.policy [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '287213336c2a4de58d9a0508e1f13ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ac6ff974d04facaff0f6cee11e9a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:58:30 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Creating image(s)
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "/opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "/opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk 1073741824" returned: 0 in 0.048s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Successfully created port: cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Cannot resize image /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Ensure instance console log exists: /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Successfully updated port: cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquired lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-98d8f97e-3475-403f-aa2a-ebd9e8bb4ed3 req-5308e60f-072d-4172-a5b4-6fbf4a11bc76 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received event network-changed-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-98d8f97e-3475-403f-aa2a-ebd9e8bb4ed3 req-5308e60f-072d-4172-a5b4-6fbf4a11bc76 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Refreshing instance network info cache due to event network-changed-cd5032a6-56b5-4ac4-9f94-34a1503d46bb. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-98d8f97e-3475-403f-aa2a-ebd9e8bb4ed3 req-5308e60f-072d-4172-a5b4-6fbf4a11bc76 service nova] Acquiring lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating instance_info_cache with network_info: [{"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Releasing lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Instance network_info: |[{"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-98d8f97e-3475-403f-aa2a-ebd9e8bb4ed3 req-5308e60f-072d-4172-a5b4-6fbf4a11bc76 service nova] Acquired lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-98d8f97e-3475-403f-aa2a-ebd9e8bb4ed3 req-5308e60f-072d-4172-a5b4-6fbf4a11bc76 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Refreshing network info cache for port cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Start _get_guest_xml network_info=[{"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:58:32 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:58:32 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-785215681',display_name='tempest-SnapshotDataIntegrityTests-server-785215681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-785215681',id=43,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVOrRB3VpJ2/6pV2x8jZN5tJvXQvgMfm6d8LvHE9cdI9SC0jzUYJlvOn6ZceoFvvQ++TxmNLg87ObRcJMhLKhZ4HbemcHU8PtGuseCfBlGaP6mxSYXRxIMtwRdrKoQSNg==',key_name='tempest-keypair-1701235588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2ac6ff974d04facaff0f6cee11e9a01',ramdisk_id='',reservation_id='r-fc4zs06z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2118105795',owner_user_name='tempest-SnapshotDataIntegrityTests-2118105795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='287213336c2a4de58d9a0508e1f13ae7',uuid=bf56558d-23ef-4fe7-859c-6120ec5e6587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Converting VIF {"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:e4:04,bridge_name='br-int',has_traffic_filtering=True,id=cd5032a6-56b5-4ac4-9f94-34a1503d46bb,network=Network(a1387944-e2a3-4887-9fbb-eab53f78bbed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd5032a6-56') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.objects.instance [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'pci_devices' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:58:32 user nova-compute[76442]:   <uuid>bf56558d-23ef-4fe7-859c-6120ec5e6587</uuid>
Nov 14 20:58:32 user nova-compute[76442]:   <name>instance-0000002b</name>
Nov 14 20:58:32 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:58:32 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:58:32 user nova-compute[76442]:   <metadata>
Nov 14 20:58:32 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:58:32 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:58:32 user nova-compute[76442]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-785215681</nova:name>
Nov 14 20:58:32 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:58:32</nova:creationTime>
Nov 14 20:58:32 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:58:32 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:58:32 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:58:32 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:58:32 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:58:32 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:58:32 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:58:32 user nova-compute[76442]:       <nova:owner>
Nov 14 20:58:32 user nova-compute[76442]:         <nova:user uuid="287213336c2a4de58d9a0508e1f13ae7">tempest-SnapshotDataIntegrityTests-2118105795-project-member</nova:user>
Nov 14 20:58:32 user nova-compute[76442]:         <nova:project uuid="b2ac6ff974d04facaff0f6cee11e9a01">tempest-SnapshotDataIntegrityTests-2118105795</nova:project>
Nov 14 20:58:32 user nova-compute[76442]:       </nova:owner>
Nov 14 20:58:32 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:58:32 user nova-compute[76442]:       <nova:ports>
Nov 14 20:58:32 user nova-compute[76442]:         <nova:port uuid="cd5032a6-56b5-4ac4-9f94-34a1503d46bb">
Nov 14 20:58:32 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 20:58:32 user nova-compute[76442]:         </nova:port>
Nov 14 20:58:32 user nova-compute[76442]:       </nova:ports>
Nov 14 20:58:32 user nova-compute[76442]:     </nova:instance>
Nov 14 20:58:32 user nova-compute[76442]:   </metadata>
Nov 14 20:58:32 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:58:32 user nova-compute[76442]:     <system>
Nov 14 20:58:32 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:58:32 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:58:32 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:58:32 user nova-compute[76442]:       <entry name="serial">bf56558d-23ef-4fe7-859c-6120ec5e6587</entry>
Nov 14 20:58:32 user nova-compute[76442]:       <entry name="uuid">bf56558d-23ef-4fe7-859c-6120ec5e6587</entry>
Nov 14 20:58:32 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:58:32 user nova-compute[76442]:     </system>
Nov 14 20:58:32 user nova-compute[76442]:   </sysinfo>
Nov 14 20:58:32 user nova-compute[76442]:   <os>
Nov 14 20:58:32 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:58:32 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:58:32 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:58:32 user nova-compute[76442]:   </os>
Nov 14 20:58:32 user nova-compute[76442]:   <features>
Nov 14 20:58:32 user nova-compute[76442]:     <acpi/>
Nov 14 20:58:32 user nova-compute[76442]:     <apic/>
Nov 14 20:58:32 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:58:32 user nova-compute[76442]:   </features>
Nov 14 20:58:32 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:58:32 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:58:32 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:58:32 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:58:32 user nova-compute[76442]:   </clock>
Nov 14 20:58:32 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:58:32 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:58:32 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:58:32 user nova-compute[76442]:   </cpu>
Nov 14 20:58:32 user nova-compute[76442]:   <devices>
Nov 14 20:58:32 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:58:32 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:58:32 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk"/>
Nov 14 20:58:32 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:58:32 user nova-compute[76442]:     </disk>
Nov 14 20:58:32 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:58:32 user nova-compute[76442]:       <mac address="fa:16:3e:d3:e4:04"/>
Nov 14 20:58:32 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:58:32 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:58:32 user nova-compute[76442]:       <target dev="tapcd5032a6-56"/>
Nov 14 20:58:32 user nova-compute[76442]:     </interface>
Nov 14 20:58:32 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:58:32 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/console.log" append="off"/>
Nov 14 20:58:32 user nova-compute[76442]:     </serial>
Nov 14 20:58:32 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:58:32 user nova-compute[76442]:     <video>
Nov 14 20:58:32 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:58:32 user nova-compute[76442]:     </video>
Nov 14 20:58:32 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:58:32 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:58:32 user nova-compute[76442]:     </rng>
Nov 14 20:58:32 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:58:32 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:58:32 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:58:32 user nova-compute[76442]:     </memballoon>
Nov 14 20:58:32 user nova-compute[76442]:   </devices>
Nov 14 20:58:32 user nova-compute[76442]: </domain>
Nov 14 20:58:32 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-785215681',display_name='tempest-SnapshotDataIntegrityTests-server-785215681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-785215681',id=43,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVOrRB3VpJ2/6pV2x8jZN5tJvXQvgMfm6d8LvHE9cdI9SC0jzUYJlvOn6ZceoFvvQ++TxmNLg87ObRcJMhLKhZ4HbemcHU8PtGuseCfBlGaP6mxSYXRxIMtwRdrKoQSNg==',key_name='tempest-keypair-1701235588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2ac6ff974d04facaff0f6cee11e9a01',ramdisk_id='',reservation_id='r-fc4zs06z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2118105795',owner_user_name='tempest-SnapshotDataIntegrityTests-2118105795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='287213336c2a4de58d9a0508e1f13ae7',uuid=bf56558d-23ef-4fe7-859c-6120ec5e6587,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Converting VIF {"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:e4:04,bridge_name='br-int',has_traffic_filtering=True,id=cd5032a6-56b5-4ac4-9f94-34a1503d46bb,network=Network(a1387944-e2a3-4887-9fbb-eab53f78bbed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd5032a6-56') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG os_vif [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:e4:04,bridge_name='br-int',has_traffic_filtering=True,id=cd5032a6-56b5-4ac4-9f94-34a1503d46bb,network=Network(a1387944-e2a3-4887-9fbb-eab53f78bbed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd5032a6-56') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff43ad12-4310-558a-9b2b-666815c461a0', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd5032a6-56, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd5032a6-56, col_values=(('qos', UUID('ee4fdfeb-2adf-4423-bb5e-dd6cc7a7408e')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd5032a6-56, col_values=(('external_ids', {'iface-id': 'cd5032a6-56b5-4ac4-9f94-34a1503d46bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:e4:04', 'vm-uuid': 'bf56558d-23ef-4fe7-859c-6120ec5e6587'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:32 user nova-compute[76442]: INFO os_vif [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:e4:04,bridge_name='br-int',has_traffic_filtering=True,id=cd5032a6-56b5-4ac4-9f94-34a1503d46bb,network=Network(a1387944-e2a3-4887-9fbb-eab53f78bbed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd5032a6-56')
Nov 14 20:58:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No VIF found with MAC fa:16:3e:d3:e4:04, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-98d8f97e-3475-403f-aa2a-ebd9e8bb4ed3 req-5308e60f-072d-4172-a5b4-6fbf4a11bc76 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updated VIF entry in instance network info cache for port cd5032a6-56b5-4ac4-9f94-34a1503d46bb. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG nova.network.neutron [req-98d8f97e-3475-403f-aa2a-ebd9e8bb4ed3 req-5308e60f-072d-4172-a5b4-6fbf4a11bc76 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating instance_info_cache with network_info: [{"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:58:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-98d8f97e-3475-403f-aa2a-ebd9e8bb4ed3 req-5308e60f-072d-4172-a5b4-6fbf4a11bc76 service nova] Releasing lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:58:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-e460c955-6049-4061-8d3e-a5388bd6d8b8 req-abc4644c-a2a3-4e16-bd9e-3286d3c39dc4 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received event network-vif-plugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e460c955-6049-4061-8d3e-a5388bd6d8b8 req-abc4644c-a2a3-4e16-bd9e-3286d3c39dc4 service nova] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e460c955-6049-4061-8d3e-a5388bd6d8b8 req-abc4644c-a2a3-4e16-bd9e-3286d3c39dc4 service nova] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e460c955-6049-4061-8d3e-a5388bd6d8b8 req-abc4644c-a2a3-4e16-bd9e-3286d3c39dc4 service nova] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-e460c955-6049-4061-8d3e-a5388bd6d8b8 req-abc4644c-a2a3-4e16-bd9e-3286d3c39dc4 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] No waiting events found dispatching network-vif-plugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:34 user nova-compute[76442]: WARNING nova.compute.manager [req-e460c955-6049-4061-8d3e-a5388bd6d8b8 req-abc4644c-a2a3-4e16-bd9e-3286d3c39dc4 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received unexpected event network-vif-plugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb for instance with vm_state building and task_state spawning.
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:34 user nova-compute[76442]: INFO nova.compute.manager [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Terminating instance
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-363b0a52-20d0-4268-8f14-40f0faa1355c req-6aec2947-e40e-41e0-9414-58e284165c94 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-unplugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-363b0a52-20d0-4268-8f14-40f0faa1355c req-6aec2947-e40e-41e0-9414-58e284165c94 service nova] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-363b0a52-20d0-4268-8f14-40f0faa1355c req-6aec2947-e40e-41e0-9414-58e284165c94 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-363b0a52-20d0-4268-8f14-40f0faa1355c req-6aec2947-e40e-41e0-9414-58e284165c94 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-363b0a52-20d0-4268-8f14-40f0faa1355c req-6aec2947-e40e-41e0-9414-58e284165c94 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] No waiting events found dispatching network-vif-unplugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.compute.manager [req-363b0a52-20d0-4268-8f14-40f0faa1355c req-6aec2947-e40e-41e0-9414-58e284165c94 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-unplugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Instance destroyed successfully.
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.objects.instance [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lazy-loading 'resources' on Instance uuid f372cd49-b14f-49ae-9ffe-722822ae4ad9 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-224416208',display_name='tempest-TestMinimumBasicScenario-server-224416208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-224416208',id=38,image_ref='940c224e-d601-4d29-b75a-9b9a9529d557',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdsZGLepXUhypbgxgzv/Dl4G6z6bB3wMe8p/sPfAUKpwPz2iLr3ncrYImhpyfjKQBH35xmAQc3DoSQxroN98PVbmI+pDXBdyKRWjqh37WhnjiSDzwBv9+Cf1tqCmxm2+w==',key_name='tempest-TestMinimumBasicScenario-582632526',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:53:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dc5de9e6eaa43439c6d0b2b1c1dccf8',ramdisk_id='',reservation_id='r-8ffdetfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='940c224e-d601-4d29-b75a-9b9a9529d557',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1647137476',owner_user_name='tempest-TestMinimumBasicScenario-1647137476-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:55:56Z,user_data=None,user_id='45d53bb1eb4f416fa202ada14ba5ca10',uuid=f372cd49-b14f-49ae-9ffe-722822ae4ad9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converting VIF {"id": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "address": "fa:16:3e:93:60:73", "network": {"id": "bbf3769e-3448-4dd7-95af-18526b55cc63", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1955526881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dc5de9e6eaa43439c6d0b2b1c1dccf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0356fbfc-6a", "ovs_interfaceid": "0356fbfc-6a6d-4f06-b191-f2dd7d056d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:60:73,bridge_name='br-int',has_traffic_filtering=True,id=0356fbfc-6a6d-4f06-b191-f2dd7d056d86,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0356fbfc-6a') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG os_vif [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:60:73,bridge_name='br-int',has_traffic_filtering=True,id=0356fbfc-6a6d-4f06-b191-f2dd7d056d86,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0356fbfc-6a') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0356fbfc-6a, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=370f79ac-f310-4f62-88ab-507bb66648f7) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:35 user nova-compute[76442]: INFO os_vif [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:60:73,bridge_name='br-int',has_traffic_filtering=True,id=0356fbfc-6a6d-4f06-b191-f2dd7d056d86,network=Network(bbf3769e-3448-4dd7-95af-18526b55cc63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0356fbfc-6a')
Nov 14 20:58:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Deleting instance files /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9_del
Nov 14 20:58:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Deletion of /opt/stack/data/nova/instances/f372cd49-b14f-49ae-9ffe-722822ae4ad9_del complete
Nov 14 20:58:35 user nova-compute[76442]: INFO nova.compute.manager [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 20:58:35 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:58:35 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:58:35 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:58:35 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:58:35 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Took 0.56 seconds to deallocate network for instance.
Nov 14 20:58:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:35 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:58:35 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:58:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:35 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Deleted allocations for instance f372cd49-b14f-49ae-9ffe-722822ae4ad9
Nov 14 20:58:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c5ad95e6-2978-45d1-8900-ba3134dafd86 tempest-TestMinimumBasicScenario-1647137476 tempest-TestMinimumBasicScenario-1647137476-project-member] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.790s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:58:36 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Instance spawned successfully.
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-bc6a07d8-7f10-4d09-a788-82b3a548c082 req-0868e98a-013f-41c9-95f4-c7fb26b7e5de service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received event network-vif-plugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bc6a07d8-7f10-4d09-a788-82b3a548c082 req-0868e98a-013f-41c9-95f4-c7fb26b7e5de service nova] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bc6a07d8-7f10-4d09-a788-82b3a548c082 req-0868e98a-013f-41c9-95f4-c7fb26b7e5de service nova] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bc6a07d8-7f10-4d09-a788-82b3a548c082 req-0868e98a-013f-41c9-95f4-c7fb26b7e5de service nova] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-bc6a07d8-7f10-4d09-a788-82b3a548c082 req-0868e98a-013f-41c9-95f4-c7fb26b7e5de service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] No waiting events found dispatching network-vif-plugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:36 user nova-compute[76442]: WARNING nova.compute.manager [req-bc6a07d8-7f10-4d09-a788-82b3a548c082 req-0868e98a-013f-41c9-95f4-c7fb26b7e5de service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received unexpected event network-vif-plugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb for instance with vm_state building and task_state spawning.
Nov 14 20:58:36 user nova-compute[76442]: INFO nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:58:36 user nova-compute[76442]: INFO nova.compute.manager [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Took 6.19 seconds to build instance.
Nov 14 20:58:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8791aea1-bacc-4433-8e3b-9f0215dd3ca6 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.384s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-9092e822-30e4-4e6d-8bbf-3e52a30e77f8 req-1b1fd43e-2f4b-4617-8be0-4653978ea5e8 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9092e822-30e4-4e6d-8bbf-3e52a30e77f8 req-1b1fd43e-2f4b-4617-8be0-4653978ea5e8 service nova] Acquiring lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9092e822-30e4-4e6d-8bbf-3e52a30e77f8 req-1b1fd43e-2f4b-4617-8be0-4653978ea5e8 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9092e822-30e4-4e6d-8bbf-3e52a30e77f8 req-1b1fd43e-2f4b-4617-8be0-4653978ea5e8 service nova] Lock "f372cd49-b14f-49ae-9ffe-722822ae4ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-9092e822-30e4-4e6d-8bbf-3e52a30e77f8 req-1b1fd43e-2f4b-4617-8be0-4653978ea5e8 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] No waiting events found dispatching network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:36 user nova-compute[76442]: WARNING nova.compute.manager [req-9092e822-30e4-4e6d-8bbf-3e52a30e77f8 req-1b1fd43e-2f4b-4617-8be0-4653978ea5e8 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received unexpected event network-vif-plugged-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 for instance with vm_state deleted and task_state None.
Nov 14 20:58:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-9092e822-30e4-4e6d-8bbf-3e52a30e77f8 req-1b1fd43e-2f4b-4617-8be0-4653978ea5e8 service nova] [instance: f372cd49-b14f-49ae-9ffe-722822ae4ad9] Received event network-vif-deleted-0356fbfc-6a6d-4f06-b191-f2dd7d056d86 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "e62b2506-c519-49bd-a678-0da035a6b1a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:52 user nova-compute[76442]: INFO nova.compute.manager [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Terminating instance
Nov 14 20:58:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-4d819f6a-dd42-4c69-af2d-ab38a74434bd req-d2267e7a-d066-4b6b-94c4-18ca056b64ac service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received event network-vif-unplugged-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4d819f6a-dd42-4c69-af2d-ab38a74434bd req-d2267e7a-d066-4b6b-94c4-18ca056b64ac service nova] Acquiring lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4d819f6a-dd42-4c69-af2d-ab38a74434bd req-d2267e7a-d066-4b6b-94c4-18ca056b64ac service nova] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4d819f6a-dd42-4c69-af2d-ab38a74434bd req-d2267e7a-d066-4b6b-94c4-18ca056b64ac service nova] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-4d819f6a-dd42-4c69-af2d-ab38a74434bd req-d2267e7a-d066-4b6b-94c4-18ca056b64ac service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] No waiting events found dispatching network-vif-unplugged-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-4d819f6a-dd42-4c69-af2d-ab38a74434bd req-d2267e7a-d066-4b6b-94c4-18ca056b64ac service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received event network-vif-unplugged-0b8cae45-a556-4485-b884-75f84893d0dd for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Instance destroyed successfully.
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.objects.instance [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lazy-loading 'resources' on Instance uuid e62b2506-c519-49bd-a678-0da035a6b1a9 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-714286513',display_name='tempest-ServerActionsTestOtherA-server-714286513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-714286513',id=20,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoMdApy2/8RPeA4MJeY2Nu8Fs1E5GIuT9rjXghW7E9nGEEJp3g35T0Y9hTYfuPiIewBxyfqXb2Q0ojDzSguW+OQkINVwKKH0JhOm94wxqmTbduWYc6NzfRIomyekkQ6+w==',key_name='tempest-keypair-553797527',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='265a9c8786db48c78145d1388a5c321f',ramdisk_id='',reservation_id='r-e95lgx1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-887472165',owner_user_name='tempest-ServerActionsTestOtherA-887472165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b873835b5e341c5aebfd4ded5f2c093',uuid=e62b2506-c519-49bd-a678-0da035a6b1a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converting VIF {"id": "0b8cae45-a556-4485-b884-75f84893d0dd", "address": "fa:16:3e:1a:03:f0", "network": {"id": "e24fe718-f56a-45f4-b237-1baf5bfe390a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-723030657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265a9c8786db48c78145d1388a5c321f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b8cae45-a5", "ovs_interfaceid": "0b8cae45-a556-4485-b884-75f84893d0dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0b8cae45-a556-4485-b884-75f84893d0dd,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b8cae45-a5') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG os_vif [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0b8cae45-a556-4485-b884-75f84893d0dd,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b8cae45-a5') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b8cae45-a5, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef6c9897-709e-423f-b1b1-86897339f30c) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:58:53 user nova-compute[76442]: INFO os_vif [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0b8cae45-a556-4485-b884-75f84893d0dd,network=Network(e24fe718-f56a-45f4-b237-1baf5bfe390a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b8cae45-a5')
Nov 14 20:58:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Deleting instance files /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9_del
Nov 14 20:58:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Deletion of /opt/stack/data/nova/instances/e62b2506-c519-49bd-a678-0da035a6b1a9_del complete
Nov 14 20:58:53 user nova-compute[76442]: INFO nova.compute.manager [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 14 20:58:53 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:58:53 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Took 0.39 seconds to deallocate network for instance.
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-dc2867a1-dec0-474d-a36a-8f4d259f4655 req-64a122f0-db27-4ec6-b6ce-f5ef226d485e service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received event network-vif-deleted-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:58:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:53 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Deleted allocations for instance e62b2506-c519-49bd-a678-0da035a6b1a9
Nov 14 20:58:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-825a27b8-91f7-4dc4-9012-496ac1ba7082 tempest-ServerActionsTestOtherA-887472165 tempest-ServerActionsTestOtherA-887472165-project-member] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.415s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-accba66b-c964-48c7-91c5-f3168a0ccb3d req-1b863d4a-ca2e-4920-9cf1-c76c9e89f668 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received event network-vif-plugged-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:58:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-accba66b-c964-48c7-91c5-f3168a0ccb3d req-1b863d4a-ca2e-4920-9cf1-c76c9e89f668 service nova] Acquiring lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:58:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-accba66b-c964-48c7-91c5-f3168a0ccb3d req-1b863d4a-ca2e-4920-9cf1-c76c9e89f668 service nova] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:58:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-accba66b-c964-48c7-91c5-f3168a0ccb3d req-1b863d4a-ca2e-4920-9cf1-c76c9e89f668 service nova] Lock "e62b2506-c519-49bd-a678-0da035a6b1a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:58:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-accba66b-c964-48c7-91c5-f3168a0ccb3d req-1b863d4a-ca2e-4920-9cf1-c76c9e89f668 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] No waiting events found dispatching network-vif-plugged-0b8cae45-a556-4485-b884-75f84893d0dd {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:58:54 user nova-compute[76442]: WARNING nova.compute.manager [req-accba66b-c964-48c7-91c5-f3168a0ccb3d req-1b863d4a-ca2e-4920-9cf1-c76c9e89f668 service nova] [instance: e62b2506-c519-49bd-a678-0da035a6b1a9] Received unexpected event network-vif-plugged-0b8cae45-a556-4485-b884-75f84893d0dd for instance with vm_state deleted and task_state None.
Nov 14 20:58:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:58:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:59:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:14 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:59:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 20:59:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:59:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 20:59:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 20:59:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:59:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:59:20 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updating instance_info_cache with network_info: [{"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:23 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:59:23 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:59:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8680MB free_disk=25.052616119384766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 72f09c08-c10c-4449-941f-4dd5c9737d43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 363657a6-e0d6-4f1b-97be-f5f936a2479c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance bf56558d-23ef-4fe7-859c-6120ec5e6587 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 20:59:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "1e294e17-c14e-427a-a302-11fcf10e8438" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:59:25 user nova-compute[76442]: INFO nova.compute.claims [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Claim successful on node user
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.network.neutron [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:59:25 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.policy [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f2d3fa02ad4ccbb286f49b8e59563d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaf0b599d7c4224be5cab0f23b95157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:59:25 user nova-compute[76442]: INFO nova.virt.block_device [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Booting with volume bc0a8f3e-4b79-4282-af0b-b1c92eb92819 at /dev/vda
Nov 14 20:59:25 user nova-compute[76442]: DEBUG os_brick.utils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b668a59f-5834-4976-8a5a-2e11afca6b44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce08dfc-d536-47e4-95c9-166440164c6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbc2dd2-190c-4ed6-b480-dcb47bba2cf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d670e353-a00c-4a8d-b2b3-c2670f9f0ca6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:59:25 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:59:25 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bc088e-9446-4ae2-aaaa-61a3d19cbeab]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG os_brick.utils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:59:25 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updating existing volume attachment record: 9dc0b85d-d805-4a25-8f36-1667456e4726 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:59:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Successfully created port: a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:59:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Successfully updated port: a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:59:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:59:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquired lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:59:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:59:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-0f907a86-b39c-412a-a48b-105e6a07d334 req-73613c62-e17b-4175-be75-8fb79d6b8bf1 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-changed-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:59:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-0f907a86-b39c-412a-a48b-105e6a07d334 req-73613c62-e17b-4175-be75-8fb79d6b8bf1 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Refreshing instance network info cache due to event network-changed-a667547a-b001-4a96-a8fa-9cc318543e16. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:59:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0f907a86-b39c-412a-a48b-105e6a07d334 req-73613c62-e17b-4175-be75-8fb79d6b8bf1 service nova] Acquiring lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updating instance_info_cache with network_info: [{"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Releasing lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Instance network_info: |[{"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0f907a86-b39c-412a-a48b-105e6a07d334 req-73613c62-e17b-4175-be75-8fb79d6b8bf1 service nova] Acquired lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG nova.network.neutron [req-0f907a86-b39c-412a-a48b-105e6a07d334 req-73613c62-e17b-4175-be75-8fb79d6b8bf1 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Refreshing network info cache for port a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG nova.network.neutron [req-0f907a86-b39c-412a-a48b-105e6a07d334 req-73613c62-e17b-4175-be75-8fb79d6b8bf1 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updated VIF entry in instance network info cache for port a667547a-b001-4a96-a8fa-9cc318543e16. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG nova.network.neutron [req-0f907a86-b39c-412a-a48b-105e6a07d334 req-73613c62-e17b-4175-be75-8fb79d6b8bf1 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updating instance_info_cache with network_info: [{"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:59:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0f907a86-b39c-412a-a48b-105e6a07d334 req-73613c62-e17b-4175-be75-8fb79d6b8bf1 service nova] Releasing lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:59:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:59:30 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Creating image(s)
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Ensure instance console log exists: /opt/stack/data/nova/instances/1e294e17-c14e-427a-a302-11fcf10e8438/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Start _get_guest_xml network_info=[{"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buDoJfIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e294e17-c14e-427a-a302-11fcf10e8438', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc0a8f3e-4b79-4282-af0b-b1c92eb92819', 'serial': 'bc0a8f3e-4b79-4282-af0b-b1c92eb92819'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '9dc0b85d-d805-4a25-8f36-1667456e4726', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:59:30 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:59:30 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buDoJfIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:59:30 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:59:30 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:59:30 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6becbc-50fe-4ec9-b86c-e6068b18fde5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:59:30 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f748c80-e4f9-44f6-9db5-4c04b33bc165]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819] added
Nov 14 20:59:30 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7511f1c-e3f0-4b72-8ce9-541be2026508]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[196627e7-b355-403a-b0fb-74564772ab4d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buDoJfIq {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buDoJfIq" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[761a5d6f-3fc5-438d-b9b5-d5df475f6db3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'buDoJfIq'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0099d9a5-5a75-479e-ab03-3bb1749066de]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f92e8eb-a145-439a-9b7b-6be05d7e1e6d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 20:59:30 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 20:59:30 user nova-compute[76442]:  {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:59:30 user nova-compute[76442]: WARNING os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 20:59:30 user nova-compute[76442]: 
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[346e533b-79a8-4663-bd6f-ee6c8e1a7342]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819, portal: 172.16.0.220,3260]
Nov 14 20:59:30 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819, portal: 172.16.0.220,3260] successful.
Nov 14 20:59:30 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea51745-6603-4ad3-831e-c1da60bb1dff]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[97af3c8c-ef3b-4673-a4c0-84adceae0e9a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 20:59:30 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 20:59:30 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b5586-dcce-4ba8-9013-155ab4b40eed]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:30 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buDoJfIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '26463333333646262', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463333333646262', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-529778262',display_name='tempest-TestVolumeBootPattern-volume-backed-server-529778262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-529778262',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxLO1ahTdCiXDYFdTuotD1+dV5qOpGGQ2qeoj8Ek718jpRkc+XLz7ZmayhleP/d1uJH6eAY3Tbj/OrQSsuXLvunqGQ4IGaXj4ryMsJmMbiRPMFEkZvAa6p0ZmJ3ySVztA==',key_name='tempest-keypair-99483608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-6wn9jxkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=1e294e17-c14e-427a-a302-11fcf10e8438,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6b:57,bridge_name='br-int',has_traffic_filtering=True,id=a667547a-b001-4a96-a8fa-9cc318543e16,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa667547a-b0') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.objects.instance [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e294e17-c14e-427a-a302-11fcf10e8438 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:59:31 user nova-compute[76442]:   <uuid>1e294e17-c14e-427a-a302-11fcf10e8438</uuid>
Nov 14 20:59:31 user nova-compute[76442]:   <name>instance-0000002c</name>
Nov 14 20:59:31 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:59:31 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:59:31 user nova-compute[76442]:   <metadata>
Nov 14 20:59:31 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:59:31 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:59:31 user nova-compute[76442]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-529778262</nova:name>
Nov 14 20:59:31 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:59:30</nova:creationTime>
Nov 14 20:59:31 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:59:31 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:59:31 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:59:31 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:59:31 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:59:31 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:59:31 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:59:31 user nova-compute[76442]:       <nova:owner>
Nov 14 20:59:31 user nova-compute[76442]:         <nova:user uuid="85f2d3fa02ad4ccbb286f49b8e59563d">tempest-TestVolumeBootPattern-792728264-project-member</nova:user>
Nov 14 20:59:31 user nova-compute[76442]:         <nova:project uuid="bcaf0b599d7c4224be5cab0f23b95157">tempest-TestVolumeBootPattern-792728264</nova:project>
Nov 14 20:59:31 user nova-compute[76442]:       </nova:owner>
Nov 14 20:59:31 user nova-compute[76442]:       <nova:ports>
Nov 14 20:59:31 user nova-compute[76442]:         <nova:port uuid="a667547a-b001-4a96-a8fa-9cc318543e16">
Nov 14 20:59:31 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 20:59:31 user nova-compute[76442]:         </nova:port>
Nov 14 20:59:31 user nova-compute[76442]:       </nova:ports>
Nov 14 20:59:31 user nova-compute[76442]:     </nova:instance>
Nov 14 20:59:31 user nova-compute[76442]:   </metadata>
Nov 14 20:59:31 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:59:31 user nova-compute[76442]:     <system>
Nov 14 20:59:31 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:59:31 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:59:31 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:59:31 user nova-compute[76442]:       <entry name="serial">1e294e17-c14e-427a-a302-11fcf10e8438</entry>
Nov 14 20:59:31 user nova-compute[76442]:       <entry name="uuid">1e294e17-c14e-427a-a302-11fcf10e8438</entry>
Nov 14 20:59:31 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:59:31 user nova-compute[76442]:     </system>
Nov 14 20:59:31 user nova-compute[76442]:   </sysinfo>
Nov 14 20:59:31 user nova-compute[76442]:   <os>
Nov 14 20:59:31 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:59:31 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:59:31 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:59:31 user nova-compute[76442]:   </os>
Nov 14 20:59:31 user nova-compute[76442]:   <features>
Nov 14 20:59:31 user nova-compute[76442]:     <acpi/>
Nov 14 20:59:31 user nova-compute[76442]:     <apic/>
Nov 14 20:59:31 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:59:31 user nova-compute[76442]:   </features>
Nov 14 20:59:31 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:59:31 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:59:31 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:59:31 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:59:31 user nova-compute[76442]:   </clock>
Nov 14 20:59:31 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:59:31 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:59:31 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:59:31 user nova-compute[76442]:   </cpu>
Nov 14 20:59:31 user nova-compute[76442]:   <devices>
Nov 14 20:59:31 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 20:59:31 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:59:31 user nova-compute[76442]:       <source dev="/dev/sdb"/>
Nov 14 20:59:31 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:59:31 user nova-compute[76442]:       <serial>bc0a8f3e-4b79-4282-af0b-b1c92eb92819</serial>
Nov 14 20:59:31 user nova-compute[76442]:     </disk>
Nov 14 20:59:31 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:59:31 user nova-compute[76442]:       <mac address="fa:16:3e:4f:6b:57"/>
Nov 14 20:59:31 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:59:31 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:59:31 user nova-compute[76442]:       <target dev="tapa667547a-b0"/>
Nov 14 20:59:31 user nova-compute[76442]:     </interface>
Nov 14 20:59:31 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:59:31 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/1e294e17-c14e-427a-a302-11fcf10e8438/console.log" append="off"/>
Nov 14 20:59:31 user nova-compute[76442]:     </serial>
Nov 14 20:59:31 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:59:31 user nova-compute[76442]:     <video>
Nov 14 20:59:31 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:59:31 user nova-compute[76442]:     </video>
Nov 14 20:59:31 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:59:31 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:59:31 user nova-compute[76442]:     </rng>
Nov 14 20:59:31 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:59:31 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:59:31 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:59:31 user nova-compute[76442]:     </memballoon>
Nov 14 20:59:31 user nova-compute[76442]:   </devices>
Nov 14 20:59:31 user nova-compute[76442]: </domain>
Nov 14 20:59:31 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-529778262',display_name='tempest-TestVolumeBootPattern-volume-backed-server-529778262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-529778262',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxLO1ahTdCiXDYFdTuotD1+dV5qOpGGQ2qeoj8Ek718jpRkc+XLz7ZmayhleP/d1uJH6eAY3Tbj/OrQSsuXLvunqGQ4IGaXj4ryMsJmMbiRPMFEkZvAa6p0ZmJ3ySVztA==',key_name='tempest-keypair-99483608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-6wn9jxkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=1e294e17-c14e-427a-a302-11fcf10e8438,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6b:57,bridge_name='br-int',has_traffic_filtering=True,id=a667547a-b001-4a96-a8fa-9cc318543e16,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa667547a-b0') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG os_vif [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6b:57,bridge_name='br-int',has_traffic_filtering=True,id=a667547a-b001-4a96-a8fa-9cc318543e16,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa667547a-b0') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '331372df-6f54-5692-8523-9e0c947546e1', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa667547a-b0, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa667547a-b0, col_values=(('qos', UUID('a42665d3-a417-469d-ac3d-5dee611fc886')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa667547a-b0, col_values=(('external_ids', {'iface-id': 'a667547a-b001-4a96-a8fa-9cc318543e16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:6b:57', 'vm-uuid': '1e294e17-c14e-427a-a302-11fcf10e8438'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:31 user nova-compute[76442]: INFO os_vif [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6b:57,bridge_name='br-int',has_traffic_filtering=True,id=a667547a-b001-4a96-a8fa-9cc318543e16,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa667547a-b0')
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:59:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No VIF found with MAC fa:16:3e:4f:6b:57, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:59:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-04c8ec2b-e044-4ae3-81b5-a01260d1468f req-2a73c52f-4518-44d2-ba13-03e8e6f1d574 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:59:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-04c8ec2b-e044-4ae3-81b5-a01260d1468f req-2a73c52f-4518-44d2-ba13-03e8e6f1d574 service nova] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-04c8ec2b-e044-4ae3-81b5-a01260d1468f req-2a73c52f-4518-44d2-ba13-03e8e6f1d574 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-04c8ec2b-e044-4ae3-81b5-a01260d1468f req-2a73c52f-4518-44d2-ba13-03e8e6f1d574 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-04c8ec2b-e044-4ae3-81b5-a01260d1468f req-2a73c52f-4518-44d2-ba13-03e8e6f1d574 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] No waiting events found dispatching network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:59:33 user nova-compute[76442]: WARNING nova.compute.manager [req-04c8ec2b-e044-4ae3-81b5-a01260d1468f req-2a73c52f-4518-44d2-ba13-03e8e6f1d574 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received unexpected event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 for instance with vm_state building and task_state spawning.
Nov 14 20:59:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 20:59:35 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Instance spawned successfully.
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-e383a51c-c1a2-469c-b4fb-d9f5ca32d56b req-1c2a0efe-6a66-41ec-8dcc-b279b75dc32d service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e383a51c-c1a2-469c-b4fb-d9f5ca32d56b req-1c2a0efe-6a66-41ec-8dcc-b279b75dc32d service nova] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e383a51c-c1a2-469c-b4fb-d9f5ca32d56b req-1c2a0efe-6a66-41ec-8dcc-b279b75dc32d service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e383a51c-c1a2-469c-b4fb-d9f5ca32d56b req-1c2a0efe-6a66-41ec-8dcc-b279b75dc32d service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-e383a51c-c1a2-469c-b4fb-d9f5ca32d56b req-1c2a0efe-6a66-41ec-8dcc-b279b75dc32d service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] No waiting events found dispatching network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:59:35 user nova-compute[76442]: WARNING nova.compute.manager [req-e383a51c-c1a2-469c-b4fb-d9f5ca32d56b req-1c2a0efe-6a66-41ec-8dcc-b279b75dc32d service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received unexpected event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 for instance with vm_state building and task_state spawning.
Nov 14 20:59:35 user nova-compute[76442]: INFO nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 14 20:59:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 20:59:35 user nova-compute[76442]: INFO nova.compute.manager [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Took 10.52 seconds to build instance.
Nov 14 20:59:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-c12df456-1812-47f5-9063-59fba60a9e82 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "1e294e17-c14e-427a-a302-11fcf10e8438" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.622s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-b610b1d7-4b85-4f7d-9a11-fcdc8d54da3e req-a2178e60-6020-4bcb-8a1f-d15051dc5713 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received event network-changed-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:59:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-b610b1d7-4b85-4f7d-9a11-fcdc8d54da3e req-a2178e60-6020-4bcb-8a1f-d15051dc5713 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Refreshing instance network info cache due to event network-changed-2843808a-ae7c-4a4d-a5bc-6909cb148cc6. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:59:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b610b1d7-4b85-4f7d-9a11-fcdc8d54da3e req-a2178e60-6020-4bcb-8a1f-d15051dc5713 service nova] Acquiring lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:59:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b610b1d7-4b85-4f7d-9a11-fcdc8d54da3e req-a2178e60-6020-4bcb-8a1f-d15051dc5713 service nova] Acquired lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:59:45 user nova-compute[76442]: DEBUG nova.network.neutron [req-b610b1d7-4b85-4f7d-9a11-fcdc8d54da3e req-a2178e60-6020-4bcb-8a1f-d15051dc5713 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Refreshing network info cache for port 2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG nova.objects.instance [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'flavor' on Instance uuid 363657a6-e0d6-4f1b-97be-f5f936a2479c {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-b610b1d7-4b85-4f7d-9a11-fcdc8d54da3e req-a2178e60-6020-4bcb-8a1f-d15051dc5713 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Updated VIF entry in instance network info cache for port 2843808a-ae7c-4a4d-a5bc-6909cb148cc6. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-b610b1d7-4b85-4f7d-9a11-fcdc8d54da3e req-a2178e60-6020-4bcb-8a1f-d15051dc5713 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Updating instance_info_cache with network_info: [{"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:46 user nova-compute[76442]: INFO nova.compute.manager [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Attaching volume 0c85c95e-fef8-41cc-aea7-14c1b1cb0910 to /dev/vdb
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-b610b1d7-4b85-4f7d-9a11-fcdc8d54da3e req-a2178e60-6020-4bcb-8a1f-d15051dc5713 service nova] Releasing lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG os_brick.utils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[225de002-97db-4fe2-b35e-483536568d9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b80eb0-bf36-4af8-8a58-07e0391ab183]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1e730-2505-4aee-bc3c-841f2d85e0f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab198cf-39ed-4fa3-b181-1c0e40290770]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 20:59:46 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 20:59:46 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b184946a-1376-4f78-9fb6-a7314d66bf65]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG os_brick.utils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Updating existing volume attachment record: ab49049d-5fc2-4648-a23e-33a8df4830ac {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 20:59:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azviwNKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 20:59:52 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:59:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:59:52 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 20:59:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 20:59:52 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd1048e-562e-4e28-b4b5-01d302b1e99e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 20:59:52 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69a18e7-e98a-4c24-a071-9d1b23eeda8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910] added
Nov 14 20:59:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2e0ff8-7a7e-4a2e-9ff7-6c5890e50975]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e6bf68-a636-44ec-8e67-405a57c5cdd3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v azviwNKy {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v azviwNKy" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b157030c-49b3-4cb6-bd94-469530dd1508]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'azviwNKy'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b42b7e-1f7f-4295-b230-468e0f99fbfd]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca734eeb-cfce-4cf6-94bd-7971727fb668]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 20:59:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 20:59:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c350af15-d569-400b-9883-ffb134142b7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910, portal: 172.16.0.220,3260]
Nov 14 20:59:53 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910, portal: 172.16.0.220,3260] successful.
Nov 14 20:59:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fa47cc-97bd-453b-877b-592e222c3607]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[528d59d7-1fe0-4f67-aea0-612ee1059c68]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 20:59:53 user nova-compute[76442]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 (non-flash)
Nov 14 20:59:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 20:59:53 user nova-compute[76442]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 (non-flash)
Nov 14 20:59:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d4de8b-fb97-4399-a9bb-d732f0e17cbf]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azviwNKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 20:59:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23636303865663364', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 20:59:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636303865663364', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 20:59:54 user nova-compute[76442]: DEBUG nova.objects.instance [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'flavor' on Instance uuid 363657a6-e0d6-4f1b-97be-f5f936a2479c {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:59:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 20:59:54 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:59:54 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 20:59:54 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:59:54 user nova-compute[76442]:   <serial>0c85c95e-fef8-41cc-aea7-14c1b1cb0910</serial>
Nov 14 20:59:54 user nova-compute[76442]: </disk>
Nov 14 20:59:54 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 20:59:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:59:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:59:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] No VIF found with MAC fa:16:3e:22:5c:1e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:59:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-931ea74f-6a11-4233-8d3f-879e682ea5e8 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.103s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 20:59:56 user nova-compute[76442]: INFO nova.compute.claims [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Claim successful on node user
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 20:59:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.policy [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb9d2e0b8d7b4bdf94872e2186dfad31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04176df08b194d959611acf480360493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:56 user nova-compute[76442]: INFO nova.compute.manager [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Detaching volume 0c85c95e-fef8-41cc-aea7-14c1b1cb0910
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 20:59:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Creating image(s)
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:56 user nova-compute[76442]: INFO nova.virt.block_device [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Attempting to driver detach volume 0c85c95e-fef8-41cc-aea7-14c1b1cb0910 from mountpoint /dev/vdb
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Attempting to detach device vdb from instance 363657a6-e0d6-4f1b-97be-f5f936a2479c from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:59:56 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:59:56 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 20:59:56 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:59:56 user nova-compute[76442]:   <serial>0c85c95e-fef8-41cc-aea7-14c1b1cb0910</serial>
Nov 14 20:59:56 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:59:56 user nova-compute[76442]: </disk>
Nov 14 20:59:56 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:59:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Successfully detached device vdb from instance 363657a6-e0d6-4f1b-97be-f5f936a2479c from the persistent domain config.
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 363657a6-e0d6-4f1b-97be-f5f936a2479c from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 20:59:56 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 20:59:56 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 20:59:56 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 20:59:56 user nova-compute[76442]:   <serial>0c85c95e-fef8-41cc-aea7-14c1b1cb0910</serial>
Nov 14 20:59:56 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 20:59:56 user nova-compute[76442]: </disk>
Nov 14 20:59:56 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:56 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk 1073741824" returned: 0 in 0.058s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 363657a6-e0d6-4f1b-97be-f5f936a2479c {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.200s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Successfully created port: 53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Cannot resize image /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Ensure instance console log exists: /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Successfully updated port: 53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquired lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-795639f1-0da0-4b50-b42a-84e09e23be7d req-a3bb44e3-d09a-4bf9-8949-fdda37252b7c service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-changed-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-795639f1-0da0-4b50-b42a-84e09e23be7d req-a3bb44e3-d09a-4bf9-8949-fdda37252b7c service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Refreshing instance network info cache due to event network-changed-53a0cd1a-030f-45b9-8f40-0e15dd5b214d. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-795639f1-0da0-4b50-b42a-84e09e23be7d req-a3bb44e3-d09a-4bf9-8949-fdda37252b7c service nova] Acquiring lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 20:59:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating instance_info_cache with network_info: [{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Releasing lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance network_info: |[{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-795639f1-0da0-4b50-b42a-84e09e23be7d req-a3bb44e3-d09a-4bf9-8949-fdda37252b7c service nova] Acquired lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-795639f1-0da0-4b50-b42a-84e09e23be7d req-a3bb44e3-d09a-4bf9-8949-fdda37252b7c service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Refreshing network info cache for port 53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Start _get_guest_xml network_info=[{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 20:59:58 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:59:58 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1421805467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1421805467',id=45,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcINiknkA7aCqomMgBZc2X1SnwUEE99VoWXMBQMiNMXVJy/UWIx41ju+rCyyf0a0z11bGtRnTS4EXA/kDRJlG9gRDVlMSgDaZZJ88A96cRYhM1XXtIAGlTgQdZseusryg==',key_name='tempest-keypair-2143665200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-5vkspjq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=63f99719-dcf0-4296-8c1b-8cbed44869c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'pci_devices' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 20:59:58 user nova-compute[76442]:   <uuid>63f99719-dcf0-4296-8c1b-8cbed44869c6</uuid>
Nov 14 20:59:58 user nova-compute[76442]:   <name>instance-0000002d</name>
Nov 14 20:59:58 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 20:59:58 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 20:59:58 user nova-compute[76442]:   <metadata>
Nov 14 20:59:58 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 20:59:58 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 20:59:58 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1421805467</nova:name>
Nov 14 20:59:58 user nova-compute[76442]:       <nova:creationTime>2023-11-14 20:59:58</nova:creationTime>
Nov 14 20:59:58 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 20:59:58 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 20:59:58 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 20:59:58 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 20:59:58 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 20:59:58 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 20:59:58 user nova-compute[76442]:       </nova:flavor>
Nov 14 20:59:58 user nova-compute[76442]:       <nova:owner>
Nov 14 20:59:58 user nova-compute[76442]:         <nova:user uuid="eb9d2e0b8d7b4bdf94872e2186dfad31">tempest-AttachVolumeShelveTestJSON-1848978120-project-member</nova:user>
Nov 14 20:59:58 user nova-compute[76442]:         <nova:project uuid="04176df08b194d959611acf480360493">tempest-AttachVolumeShelveTestJSON-1848978120</nova:project>
Nov 14 20:59:58 user nova-compute[76442]:       </nova:owner>
Nov 14 20:59:58 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 20:59:58 user nova-compute[76442]:       <nova:ports>
Nov 14 20:59:58 user nova-compute[76442]:         <nova:port uuid="53a0cd1a-030f-45b9-8f40-0e15dd5b214d">
Nov 14 20:59:58 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 20:59:58 user nova-compute[76442]:         </nova:port>
Nov 14 20:59:58 user nova-compute[76442]:       </nova:ports>
Nov 14 20:59:58 user nova-compute[76442]:     </nova:instance>
Nov 14 20:59:58 user nova-compute[76442]:   </metadata>
Nov 14 20:59:58 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 20:59:58 user nova-compute[76442]:     <system>
Nov 14 20:59:58 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 20:59:58 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 20:59:58 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 20:59:58 user nova-compute[76442]:       <entry name="serial">63f99719-dcf0-4296-8c1b-8cbed44869c6</entry>
Nov 14 20:59:58 user nova-compute[76442]:       <entry name="uuid">63f99719-dcf0-4296-8c1b-8cbed44869c6</entry>
Nov 14 20:59:58 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 20:59:58 user nova-compute[76442]:     </system>
Nov 14 20:59:58 user nova-compute[76442]:   </sysinfo>
Nov 14 20:59:58 user nova-compute[76442]:   <os>
Nov 14 20:59:58 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 20:59:58 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 20:59:58 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 20:59:58 user nova-compute[76442]:   </os>
Nov 14 20:59:58 user nova-compute[76442]:   <features>
Nov 14 20:59:58 user nova-compute[76442]:     <acpi/>
Nov 14 20:59:58 user nova-compute[76442]:     <apic/>
Nov 14 20:59:58 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 20:59:58 user nova-compute[76442]:   </features>
Nov 14 20:59:58 user nova-compute[76442]:   <clock offset="utc">
Nov 14 20:59:58 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 20:59:58 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 20:59:58 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 20:59:58 user nova-compute[76442]:   </clock>
Nov 14 20:59:58 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 20:59:58 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 20:59:58 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 20:59:58 user nova-compute[76442]:   </cpu>
Nov 14 20:59:58 user nova-compute[76442]:   <devices>
Nov 14 20:59:58 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 20:59:58 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 20:59:58 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk"/>
Nov 14 20:59:58 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 20:59:58 user nova-compute[76442]:     </disk>
Nov 14 20:59:58 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 20:59:58 user nova-compute[76442]:       <mac address="fa:16:3e:f5:2d:50"/>
Nov 14 20:59:58 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:59:58 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 20:59:58 user nova-compute[76442]:       <target dev="tap53a0cd1a-03"/>
Nov 14 20:59:58 user nova-compute[76442]:     </interface>
Nov 14 20:59:58 user nova-compute[76442]:     <serial type="pty">
Nov 14 20:59:58 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/console.log" append="off"/>
Nov 14 20:59:58 user nova-compute[76442]:     </serial>
Nov 14 20:59:58 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 20:59:58 user nova-compute[76442]:     <video>
Nov 14 20:59:58 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 20:59:58 user nova-compute[76442]:     </video>
Nov 14 20:59:58 user nova-compute[76442]:     <rng model="virtio">
Nov 14 20:59:58 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 20:59:58 user nova-compute[76442]:     </rng>
Nov 14 20:59:58 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 20:59:58 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 20:59:58 user nova-compute[76442]:       <stats period="10"/>
Nov 14 20:59:58 user nova-compute[76442]:     </memballoon>
Nov 14 20:59:58 user nova-compute[76442]:   </devices>
Nov 14 20:59:58 user nova-compute[76442]: </domain>
Nov 14 20:59:58 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1421805467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1421805467',id=45,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcINiknkA7aCqomMgBZc2X1SnwUEE99VoWXMBQMiNMXVJy/UWIx41ju+rCyyf0a0z11bGtRnTS4EXA/kDRJlG9gRDVlMSgDaZZJ88A96cRYhM1XXtIAGlTgQdZseusryg==',key_name='tempest-keypair-2143665200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-5vkspjq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T20:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=63f99719-dcf0-4296-8c1b-8cbed44869c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG os_vif [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e05f96a-1ef4-54fc-80f3-1df99c186cdf', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53a0cd1a-03, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53a0cd1a-03, col_values=(('qos', UUID('34f44051-799c-40b2-a4d7-634df968196f')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53a0cd1a-03, col_values=(('external_ids', {'iface-id': '53a0cd1a-030f-45b9-8f40-0e15dd5b214d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:2d:50', 'vm-uuid': '63f99719-dcf0-4296-8c1b-8cbed44869c6'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:58 user nova-compute[76442]: INFO os_vif [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03')
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] No VIF found with MAC fa:16:3e:f5:2d:50, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-795639f1-0da0-4b50-b42a-84e09e23be7d req-a3bb44e3-d09a-4bf9-8949-fdda37252b7c service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updated VIF entry in instance network info cache for port 53a0cd1a-030f-45b9-8f40-0e15dd5b214d. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG nova.network.neutron [req-795639f1-0da0-4b50-b42a-84e09e23be7d req-a3bb44e3-d09a-4bf9-8949-fdda37252b7c service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating instance_info_cache with network_info: [{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 20:59:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-795639f1-0da0-4b50-b42a-84e09e23be7d req-a3bb44e3-d09a-4bf9-8949-fdda37252b7c service nova] Releasing lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 20:59:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 20:59:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-bf743559-f0dc-4f60-8f4a-640a5dd034e2 req-573c09e7-88cd-4726-bf4a-aaa29849bb28 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 20:59:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bf743559-f0dc-4f60-8f4a-640a5dd034e2 req-573c09e7-88cd-4726-bf4a-aaa29849bb28 service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 20:59:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bf743559-f0dc-4f60-8f4a-640a5dd034e2 req-573c09e7-88cd-4726-bf4a-aaa29849bb28 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 20:59:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bf743559-f0dc-4f60-8f4a-640a5dd034e2 req-573c09e7-88cd-4726-bf4a-aaa29849bb28 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 20:59:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-bf743559-f0dc-4f60-8f4a-640a5dd034e2 req-573c09e7-88cd-4726-bf4a-aaa29849bb28 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 20:59:59 user nova-compute[76442]: WARNING nova.compute.manager [req-bf743559-f0dc-4f60-8f4a-640a5dd034e2 req-573c09e7-88cd-4726-bf4a-aaa29849bb28 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state building and task_state spawning.
Nov 14 21:00:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:00:01 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance spawned successfully.
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:00:01 user nova-compute[76442]: INFO nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 14 21:00:01 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:00:01 user nova-compute[76442]: INFO nova.compute.manager [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Took 5.96 seconds to build instance.
Nov 14 21:00:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f282f731-0af8-4eed-b288-83b1c3a45126 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.058s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-136bbcee-7d71-49ee-b184-e14350e994ed req-1bee6886-a02e-4b70-9037-7bc6298eb8fa service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:00:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-136bbcee-7d71-49ee-b184-e14350e994ed req-1bee6886-a02e-4b70-9037-7bc6298eb8fa service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-136bbcee-7d71-49ee-b184-e14350e994ed req-1bee6886-a02e-4b70-9037-7bc6298eb8fa service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-136bbcee-7d71-49ee-b184-e14350e994ed req-1bee6886-a02e-4b70-9037-7bc6298eb8fa service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-136bbcee-7d71-49ee-b184-e14350e994ed req-1bee6886-a02e-4b70-9037-7bc6298eb8fa service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:00:02 user nova-compute[76442]: WARNING nova.compute.manager [req-136bbcee-7d71-49ee-b184-e14350e994ed req-1bee6886-a02e-4b70-9037-7bc6298eb8fa service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state active and task_state None.
Nov 14 21:00:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:00:15 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:00:16 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:00:16 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:00:17 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 363657a6-e0d6-4f1b-97be-f5f936a2479c is timed out.
Nov 14 21:00:17 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Successfully detached device vdb from instance 363657a6-e0d6-4f1b-97be-f5f936a2479c from the live domain config.
Nov 14 21:00:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azviwNKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:00:17 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eed0482-eb64-4812-9dc5-4d9d964aa49b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:00:17 user nova-compute[76442]: No targets found.
Nov 14 21:00:17 user nova-compute[76442]: iSNS:
Nov 14 21:00:17 user nova-compute[76442]: No targets found.
Nov 14 21:00:17 user nova-compute[76442]: STATIC:
Nov 14 21:00:17 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819
Nov 14 21:00:17 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:00:17 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:00:17 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910
Nov 14 21:00:17 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:00:17 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:00:17 user nova-compute[76442]: FIRMWARE:
Nov 14 21:00:17 user nova-compute[76442]: No targets found.
Nov 14 21:00:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:00:17 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:00:17 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5207e4ec-fb71-40b7-b40b-599426291e67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb99a45a-1ff2-4103-9c75-1395f42832b4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:00:17 user nova-compute[76442]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 (non-flash)
Nov 14 21:00:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:00:17 user nova-compute[76442]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 (non-flash)
Nov 14 21:00:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4df41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[64968222-bdf5-498c-a794-296a52be6a14]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf5e3da-0993-49aa-bd29-79ea98bf31f8]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac4a465-9488-4474-ba8e-bf5f11239fd1]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed91cd9c-174b-4ad0-8512-7ec3790502a9]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[286bb001-a8cc-4592-b054-4f4979d8d342]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adeaa12-d599-4d8c-b2de-025a5623de84]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910, portal: 172.16.0.220,3260]
Nov 14 21:00:17 user nova-compute[76442]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910, portal: 172.16.0.220,3260] successful.
Nov 14 21:00:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c85c95e-fef8-41cc-aea7-14c1b1cb0910 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2be3357-1e51-4e7f-937c-b059d5f19b3c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] <== disconnect_volume: return (280ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:00:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:18 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'flavor' on Instance uuid 363657a6-e0d6-4f1b-97be-f5f936a2479c {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:00:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9764e4fa-57f7-4c5b-a02c-8503db6c33d5 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.831s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:00:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c958718-fa9c-4b6a-b9f3-9f2d367c06f9 req-ad5e7792-7588-4ef3-b817-59b8236e3c61 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received event network-changed-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG nova.compute.manager [req-9c958718-fa9c-4b6a-b9f3-9f2d367c06f9 req-ad5e7792-7588-4ef3-b817-59b8236e3c61 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Refreshing instance network info cache due to event network-changed-cd5032a6-56b5-4ac4-9f94-34a1503d46bb. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c958718-fa9c-4b6a-b9f3-9f2d367c06f9 req-ad5e7792-7588-4ef3-b817-59b8236e3c61 service nova] Acquiring lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c958718-fa9c-4b6a-b9f3-9f2d367c06f9 req-ad5e7792-7588-4ef3-b817-59b8236e3c61 service nova] Acquired lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG nova.network.neutron [req-9c958718-fa9c-4b6a-b9f3-9f2d367c06f9 req-ad5e7792-7588-4ef3-b817-59b8236e3c61 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Refreshing network info cache for port cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG nova.network.neutron [req-9c958718-fa9c-4b6a-b9f3-9f2d367c06f9 req-ad5e7792-7588-4ef3-b817-59b8236e3c61 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updated VIF entry in instance network info cache for port cd5032a6-56b5-4ac4-9f94-34a1503d46bb. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG nova.network.neutron [req-9c958718-fa9c-4b6a-b9f3-9f2d367c06f9 req-ad5e7792-7588-4ef3-b817-59b8236e3c61 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating instance_info_cache with network_info: [{"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9c958718-fa9c-4b6a-b9f3-9f2d367c06f9 req-ad5e7792-7588-4ef3-b817-59b8236e3c61 service nova] Releasing lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:21 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:23 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:00:23 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.05270767211914GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.objects.instance [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 72f09c08-c10c-4449-941f-4dd5c9737d43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 363657a6-e0d6-4f1b-97be-f5f936a2479c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance bf56558d-23ef-4fe7-859c-6120ec5e6587 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 1e294e17-c14e-427a-a302-11fcf10e8438 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:23 user nova-compute[76442]: INFO nova.compute.manager [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attaching volume d30b206d-2a81-4d31-b874-efd4000e9416 to /dev/vdb
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG os_brick.utils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[038a2594-ad61-4e3c-bad1-163d6a12e0e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acf5868-7b4b-4e4f-a91f-c5bb46a817fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d928f34-cada-4cc0-975a-9c36cdb0da30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[838ade97-c3f7-446e-b12a-504d1240cf5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:00:23 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:00:23 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e4245c-ba76-4b23-910c-241f015902eb]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG os_brick.utils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:00:23 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating existing volume attachment record: f5105d96-030b-4382-837d-083323d0ba9b {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:00:24 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:00:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:00:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:00:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:00:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:00:24 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:00:24 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 72f09c08-c10c-4449-941f-4dd5c9737d43 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:00:25 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updating instance_info_cache with network_info: [{"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:00:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:00:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:00:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:00:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOiVhASx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:00:28 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:00:28 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:00:28 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[967da7f9-93dc-4e7d-a187-ca441e8030c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:00:28 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4617ac-8784-45e1-9173-05b911870689]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416] added
Nov 14 21:00:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecde20b-d9c1-488c-92e7-8ba2a236b2a7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a7d8e1-14db-412e-b94a-03452a7b0cec]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOiVhASx {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOiVhASx" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3d6ee1-6c04-4ae5-8dd3-7c3b57e3f26c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kOiVhASx'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ae8fb2-6482-4088-85a6-6f6f94b9976c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32a12a7-fd0a-4e27-89f6-da662ec0f9bf]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:00:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:00:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dd894d-8379-42c8-9173-cd0843f1e573]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416, portal: 172.16.0.220,3260]
Nov 14 21:00:28 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416, portal: 172.16.0.220,3260] successful.
Nov 14 21:00:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b62f94-ed59-49d6-902f-2b9f5b378918]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1e671b-ff03-469b-a2c4-b70255159fef]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:00:28 user nova-compute[76442]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 (non-flash)
Nov 14 21:00:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:00:28 user nova-compute[76442]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 (non-flash)
Nov 14 21:00:28 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1bb54d-cd11-442e-a4aa-529c980a3576]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:00:28 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOiVhASx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:00:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:00:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23838666161393966', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:00:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838666161393966', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:00:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:00:29 user nova-compute[76442]: DEBUG nova.objects.instance [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:00:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 21:00:29 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:00:29 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:00:29 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:00:29 user nova-compute[76442]:   <serial>d30b206d-2a81-4d31-b874-efd4000e9416</serial>
Nov 14 21:00:29 user nova-compute[76442]: </disk>
Nov 14 21:00:29 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 21:00:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:00:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:00:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No VIF found with MAC fa:16:3e:d3:e4:04, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:00:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-fd8a5306-1aaa-49ca-9e49-3d83fe74f51f tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.332s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:37 user nova-compute[76442]: INFO nova.compute.manager [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Detaching volume d30b206d-2a81-4d31-b874-efd4000e9416
Nov 14 21:00:37 user nova-compute[76442]: INFO nova.virt.block_device [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attempting to driver detach volume d30b206d-2a81-4d31-b874-efd4000e9416 from mountpoint /dev/vdb
Nov 14 21:00:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Attempting to detach device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 21:00:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:00:37 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:00:37 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:00:37 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:00:37 user nova-compute[76442]:   <serial>d30b206d-2a81-4d31-b874-efd4000e9416</serial>
Nov 14 21:00:37 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:00:37 user nova-compute[76442]: </disk>
Nov 14 21:00:37 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:00:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully detached device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the persistent domain config.
Nov 14 21:00:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 21:00:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:00:37 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:00:37 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:00:37 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:00:37 user nova-compute[76442]:   <serial>d30b206d-2a81-4d31-b874-efd4000e9416</serial>
Nov 14 21:00:37 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:00:37 user nova-compute[76442]: </disk>
Nov 14 21:00:37 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:00:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 21:00:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-4313c9ea-0837-42ff-ae3e-4f3204a71676 req-d0b2af99-8c32-4e7e-b1a3-64c6978a9e07 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received event network-changed-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-4313c9ea-0837-42ff-ae3e-4f3204a71676 req-d0b2af99-8c32-4e7e-b1a3-64c6978a9e07 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Refreshing instance network info cache due to event network-changed-2843808a-ae7c-4a4d-a5bc-6909cb148cc6. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4313c9ea-0837-42ff-ae3e-4f3204a71676 req-d0b2af99-8c32-4e7e-b1a3-64c6978a9e07 service nova] Acquiring lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4313c9ea-0837-42ff-ae3e-4f3204a71676 req-d0b2af99-8c32-4e7e-b1a3-64c6978a9e07 service nova] Acquired lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-4313c9ea-0837-42ff-ae3e-4f3204a71676 req-d0b2af99-8c32-4e7e-b1a3-64c6978a9e07 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Refreshing network info cache for port 2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:47 user nova-compute[76442]: INFO nova.compute.manager [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Terminating instance
Nov 14 21:00:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Instance destroyed successfully.
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.objects.instance [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'resources' on Instance uuid 363657a6-e0d6-4f1b-97be-f5f936a2479c {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-622058940',display_name='tempest-TestStampPattern-server-622058940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-622058940',id=42,image_ref='e1c1cfad-0045-4bbf-a983-9f55e13c959f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvdINDy4N0nCmsxw9+z0YuoH3ORFDVbievK0y+5u+iZAsq6JkSs0vSSkOTyVGZyPAbS/GlayoYiP7LELDfKg0H397As/3cvk8b3zQIt0rEeH8Jo8IjV+llgBEk0dkVVig==',key_name='tempest-TestStampPattern-1089595662',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:58:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b7ef39084aa4d8faaeb192c1eaf6874',ramdisk_id='',reservation_id='r-e6v0vfnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='72f09c08-c10c-4449-941f-4dd5c9737d43',image_min_disk='1',image_min_ram='0',image_owner_id='1b7ef39084aa4d8faaeb192c1eaf6874',image_owner_project_name='tempest-TestStampPattern-369137228',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-369137228-project-member',image_user_id='64183849e82a427ea2e034ad39c70374',owner_project_name='tempest-TestStampPattern-369137228',owner_user_name='tempest-TestStampPattern-369137228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:58:01Z,user_data=None,user_id='64183849e82a427ea2e034ad39c70374',uuid=363657a6-e0d6-4f1b-97be-f5f936a2479c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converting VIF {"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:5c:1e,bridge_name='br-int',has_traffic_filtering=True,id=2843808a-ae7c-4a4d-a5bc-6909cb148cc6,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2843808a-ae') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG os_vif [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:5c:1e,bridge_name='br-int',has_traffic_filtering=True,id=2843808a-ae7c-4a4d-a5bc-6909cb148cc6,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2843808a-ae') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2843808a-ae, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57ff79bf-772d-481f-8f59-761f292ed203) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:00:48 user nova-compute[76442]: INFO os_vif [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:5c:1e,bridge_name='br-int',has_traffic_filtering=True,id=2843808a-ae7c-4a4d-a5bc-6909cb148cc6,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2843808a-ae')
Nov 14 21:00:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Deleting instance files /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c_del
Nov 14 21:00:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Deletion of /opt/stack/data/nova/instances/363657a6-e0d6-4f1b-97be-f5f936a2479c_del complete
Nov 14 21:00:48 user nova-compute[76442]: INFO nova.compute.manager [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 21:00:48 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-3609c047-2fab-4223-977b-88c99e3498ad req-70ee4e49-0728-484b-853c-be6a6206e7ea service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received event network-vif-unplugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3609c047-2fab-4223-977b-88c99e3498ad req-70ee4e49-0728-484b-853c-be6a6206e7ea service nova] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3609c047-2fab-4223-977b-88c99e3498ad req-70ee4e49-0728-484b-853c-be6a6206e7ea service nova] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3609c047-2fab-4223-977b-88c99e3498ad req-70ee4e49-0728-484b-853c-be6a6206e7ea service nova] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-3609c047-2fab-4223-977b-88c99e3498ad req-70ee4e49-0728-484b-853c-be6a6206e7ea service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] No waiting events found dispatching network-vif-unplugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-3609c047-2fab-4223-977b-88c99e3498ad req-70ee4e49-0728-484b-853c-be6a6206e7ea service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received event network-vif-unplugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.network.neutron [req-4313c9ea-0837-42ff-ae3e-4f3204a71676 req-d0b2af99-8c32-4e7e-b1a3-64c6978a9e07 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Updated VIF entry in instance network info cache for port 2843808a-ae7c-4a4d-a5bc-6909cb148cc6. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG nova.network.neutron [req-4313c9ea-0837-42ff-ae3e-4f3204a71676 req-d0b2af99-8c32-4e7e-b1a3-64c6978a9e07 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Updating instance_info_cache with network_info: [{"id": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "address": "fa:16:3e:22:5c:1e", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2843808a-ae", "ovs_interfaceid": "2843808a-ae7c-4a4d-a5bc-6909cb148cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4313c9ea-0837-42ff-ae3e-4f3204a71676 req-d0b2af99-8c32-4e7e-b1a3-64c6978a9e07 service nova] Releasing lock "refresh_cache-363657a6-e0d6-4f1b-97be-f5f936a2479c" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:00:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:49 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:00:49 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Took 1.11 seconds to deallocate network for instance.
Nov 14 21:00:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-f7844550-a541-4b56-9704-da64cde3da11 req-f47dbaaf-e654-42c6-bf27-7c1deaac88e6 service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received event network-vif-deleted-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:00:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:49 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:00:49 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:00:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:49 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Deleted allocations for instance 363657a6-e0d6-4f1b-97be-f5f936a2479c
Nov 14 21:00:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-29626227-5796-4f3d-81eb-96da3efa4a42 tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-aaa701b0-9429-48f8-a53a-9057eb78aa5b req-93615471-9515-4072-96a1-5e90027d554e service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received event network-vif-plugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:00:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aaa701b0-9429-48f8-a53a-9057eb78aa5b req-93615471-9515-4072-96a1-5e90027d554e service nova] Acquiring lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:00:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aaa701b0-9429-48f8-a53a-9057eb78aa5b req-93615471-9515-4072-96a1-5e90027d554e service nova] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:00:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-aaa701b0-9429-48f8-a53a-9057eb78aa5b req-93615471-9515-4072-96a1-5e90027d554e service nova] Lock "363657a6-e0d6-4f1b-97be-f5f936a2479c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:00:50 user nova-compute[76442]: DEBUG nova.compute.manager [req-aaa701b0-9429-48f8-a53a-9057eb78aa5b req-93615471-9515-4072-96a1-5e90027d554e service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] No waiting events found dispatching network-vif-plugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:00:50 user nova-compute[76442]: WARNING nova.compute.manager [req-aaa701b0-9429-48f8-a53a-9057eb78aa5b req-93615471-9515-4072-96a1-5e90027d554e service nova] [instance: 363657a6-e0d6-4f1b-97be-f5f936a2479c] Received unexpected event network-vif-plugged-2843808a-ae7c-4a4d-a5bc-6909cb148cc6 for instance with vm_state deleted and task_state None.
Nov 14 21:00:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:00:57 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 is timed out.
Nov 14 21:00:57 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully detached device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the live domain config.
Nov 14 21:00:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOiVhASx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:00:57 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb957181-6d74-4a08-bf3c-3112d1fa5d20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:00:57 user nova-compute[76442]: No targets found.
Nov 14 21:00:57 user nova-compute[76442]: iSNS:
Nov 14 21:00:57 user nova-compute[76442]: No targets found.
Nov 14 21:00:57 user nova-compute[76442]: STATIC:
Nov 14 21:00:57 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819
Nov 14 21:00:57 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:00:57 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:00:57 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416
Nov 14 21:00:57 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:00:57 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:00:57 user nova-compute[76442]: FIRMWARE:
Nov 14 21:00:57 user nova-compute[76442]: No targets found.
Nov 14 21:00:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:00:57 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:00:57 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ede0d8-ad0d-4a93-b50a-c62f1137d22b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[682a2aff-583a-4afe-867b-7a26288e286f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:00:57 user nova-compute[76442]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 (non-flash)
Nov 14 21:00:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:00:57 user nova-compute[76442]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 (non-flash)
Nov 14 21:00:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4d25000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bd0750-0a4f-47b5-938c-fa1aa9c2468d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[09546ff9-86d4-4adb-abd2-cf32764c5ca5]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[652297bf-2171-497c-8f07-8ec31fd848ab]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf22fd-72df-47b5-9bad-7812a62c07e1]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed05c906-122d-4456-818e-6eab043221c0]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62c9c1c-f059-471b-9249-45e00f74077a]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416, portal: 172.16.0.220,3260]
Nov 14 21:00:57 user nova-compute[76442]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416, portal: 172.16.0.220,3260] successful.
Nov 14 21:00:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:00:58 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d30b206d-2a81-4d31-b874-efd4000e9416 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:00:58 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b740b9de-43c8-4797-b911-c260593851e5]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:00:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:00:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:00:58 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== disconnect_volume: return (299ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:00:58 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:00:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:00:58 user nova-compute[76442]: DEBUG nova.objects.instance [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:00:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-40a16504-47b6-4bc7-bb74-7dd5e82b7bd2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.642s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:05 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:01:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-1db97405-6f96-445e-81e2-559f647e5cfa req-c2bf1f83-c24a-451d-b492-1c987b0d2031 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-changed-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-1db97405-6f96-445e-81e2-559f647e5cfa req-c2bf1f83-c24a-451d-b492-1c987b0d2031 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Refreshing instance network info cache due to event network-changed-a667547a-b001-4a96-a8fa-9cc318543e16. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:01:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1db97405-6f96-445e-81e2-559f647e5cfa req-c2bf1f83-c24a-451d-b492-1c987b0d2031 service nova] Acquiring lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:01:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1db97405-6f96-445e-81e2-559f647e5cfa req-c2bf1f83-c24a-451d-b492-1c987b0d2031 service nova] Acquired lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:01:16 user nova-compute[76442]: DEBUG nova.network.neutron [req-1db97405-6f96-445e-81e2-559f647e5cfa req-c2bf1f83-c24a-451d-b492-1c987b0d2031 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Refreshing network info cache for port a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:01:16 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:16 user nova-compute[76442]: DEBUG nova.network.neutron [req-1db97405-6f96-445e-81e2-559f647e5cfa req-c2bf1f83-c24a-451d-b492-1c987b0d2031 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updated VIF entry in instance network info cache for port a667547a-b001-4a96-a8fa-9cc318543e16. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:01:16 user nova-compute[76442]: DEBUG nova.network.neutron [req-1db97405-6f96-445e-81e2-559f647e5cfa req-c2bf1f83-c24a-451d-b492-1c987b0d2031 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updating instance_info_cache with network_info: [{"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:01:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1db97405-6f96-445e-81e2-559f647e5cfa req-c2bf1f83-c24a-451d-b492-1c987b0d2031 service nova] Releasing lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:01:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:18 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 21:01:20 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:22 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:01:23 user nova-compute[76442]: INFO nova.compute.claims [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Claim successful on node user
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 21:01:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.network.neutron [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:23 user nova-compute[76442]: INFO nova.virt.block_device [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Booting with volume snapshot c545a6c7-66b5-4472-a9a3-ce42b3db1690 at /dev/vda
Nov 14 21:01:23 user nova-compute[76442]: DEBUG nova.policy [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f2d3fa02ad4ccbb286f49b8e59563d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaf0b599d7c4224be5cab0f23b95157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 21:01:23 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:24 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:01:24 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8573MB free_disk=25.05072021484375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 72f09c08-c10c-4449-941f-4dd5c9737d43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance bf56558d-23ef-4fe7-859c-6120ec5e6587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 1e294e17-c14e-427a-a302-11fcf10e8438 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.network.neutron [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Successfully created port: f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:01:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.network.neutron [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Successfully updated port: f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "refresh_cache-0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquired lock "refresh_cache-0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.network.neutron [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.network.neutron [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-dfa3825c-2110-4f2a-9a1e-2b304c5d60ab req-9b1f13b7-9f14-4d54-9334-c5ae2bc37d31 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received event network-changed-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-dfa3825c-2110-4f2a-9a1e-2b304c5d60ab req-9b1f13b7-9f14-4d54-9334-c5ae2bc37d31 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Refreshing instance network info cache due to event network-changed-f29ab2cf-b520-4dca-a385-33b81aff087c. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dfa3825c-2110-4f2a-9a1e-2b304c5d60ab req-9b1f13b7-9f14-4d54-9334-c5ae2bc37d31 service nova] Acquiring lock "refresh_cache-0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.network.neutron [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Updating instance_info_cache with network_info: [{"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Releasing lock "refresh_cache-0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Instance network_info: |[{"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dfa3825c-2110-4f2a-9a1e-2b304c5d60ab req-9b1f13b7-9f14-4d54-9334-c5ae2bc37d31 service nova] Acquired lock "refresh_cache-0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.network.neutron [req-dfa3825c-2110-4f2a-9a1e-2b304c5d60ab req-9b1f13b7-9f14-4d54-9334-c5ae2bc37d31 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Refreshing network info cache for port f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.network.neutron [req-dfa3825c-2110-4f2a-9a1e-2b304c5d60ab req-9b1f13b7-9f14-4d54-9334-c5ae2bc37d31 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Updated VIF entry in instance network info cache for port f29ab2cf-b520-4dca-a385-33b81aff087c. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG nova.network.neutron [req-dfa3825c-2110-4f2a-9a1e-2b304c5d60ab req-9b1f13b7-9f14-4d54-9334-c5ae2bc37d31 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Updating instance_info_cache with network_info: [{"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:01:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-dfa3825c-2110-4f2a-9a1e-2b304c5d60ab req-9b1f13b7-9f14-4d54-9334-c5ae2bc37d31 service nova] Releasing lock "refresh_cache-0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating instance_info_cache with network_info: [{"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_power_states {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:26 user nova-compute[76442]: WARNING nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Nov 14 21:01:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 72f09c08-c10c-4449-941f-4dd5c9737d43 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 1e294e17-c14e-427a-a302-11fcf10e8438 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "1e294e17-c14e-427a-a302-11fcf10e8438" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "1e294e17-c14e-427a-a302-11fcf10e8438" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:29 user nova-compute[76442]: INFO nova.compute.manager [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attaching volume f606f01c-2e06-43e9-a4a0-616a52f038f6 to /dev/vdb
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.utils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[21901583-cc49-4b5a-8bd0-55803e2341c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb653f8-7d08-4dc7-b3d7-ae570add1397]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[85476b38-3ac5-4bec-8d10-3d84d774bc3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f027bfaf-080d-44ba-95b7-16c0af26f6a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:01:29 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af42e11-953a-45c9-b598-e120ecf5c1ba]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.utils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating existing volume attachment record: 341334a3-4dd8-4465-a014-a5b88754a63b {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.utils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c014fe-60c9-40e8-9085-4d9995be03b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25b6d11-deab-4063-be97-94cd68054e33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ab429c-8650-4000-aab0-211edeee204b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[337defb8-e2d2-4916-95f5-ce35ab2fc4b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:01:29 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:01:29 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[653d6cae-1c9b-4e1e-a31b-096dbbec29c7]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG os_brick.utils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:01:29 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Updating existing volume attachment record: 12f6a820-96b3-41b6-bdb8-aa8fdba912e5 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:01:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAdHcKNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:01:37 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:01:37 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:01:37 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e22217-41da-4fa0-88c4-8b81c80d69ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:01:37 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[788949c6-aecd-4561-a2b1-9e30ffe60507]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6] added
Nov 14 21:01:37 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[208586ed-212f-41c1-a3ca-dc5cb0dc2377]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9c5508-a893-4c38-8044-160224f593b2]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAdHcKNr {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAdHcKNr" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf65b0-186d-49c8-bbb0-6fc667f20186]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAdHcKNr'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3f8694-f854-4589-82e1-74cf8dd60623]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b483a473-23e7-46c5-b7ac-bbf4309f40b1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:01:37 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:01:37 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:01:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Creating image(s)
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Ensure instance console log exists: /opt/stack/data/nova/instances/0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Start _get_guest_xml network_info=[{"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T21:01:19Z,direct_url=<?>,disk_format='qcow2',id=4c2d1c22-cc52-451b-ac76-de1434d052a6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-512267824',owner='bcaf0b599d7c4224be5cab0f23b95157',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T21:01:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'terkOdVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc', 'attached_at': '', 'detached_at': '', 'volume_id': 'a867541c-d4cd-451c-b511-54187d7c63f3', 'serial': 'a867541c-d4cd-451c-b511-54187d7c63f3'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '12f6a820-96b3-41b6-bdb8-aa8fdba912e5', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:01:37 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:01:37 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T21:01:19Z,direct_url=<?>,disk_format='qcow2',id=4c2d1c22-cc52-451b-ac76-de1434d052a6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-512267824',owner='bcaf0b599d7c4224be5cab0f23b95157',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T21:01:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'terkOdVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:01:37 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ba0428-ffb1-4dd5-a83d-5fc155a300bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6, portal: 172.16.0.220,3260]
Nov 14 21:01:37 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6, portal: 172.16.0.220,3260] successful.
Nov 14 21:01:37 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b99409b-71ea-42e3-8e8f-b1e395513506]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[92316a66-5ef2-4aec-9a5b-3d06b6c8a34c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:01:38 user nova-compute[76442]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)
Nov 14 21:01:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:01:38 user nova-compute[76442]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)
Nov 14 21:01:38 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19e7f6a-0aae-4298-a507-9a20beb26b35]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAdHcKNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:01:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23230313433613862', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230313433613862', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.078s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:01:39 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:01:39 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b758288-7065-404c-850b-c1b350d58348]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:01:39 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 21:01:39 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:01:39 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:01:39 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:01:39 user nova-compute[76442]:   <serial>f606f01c-2e06-43e9-a4a0-616a52f038f6</serial>
Nov 14 21:01:39 user nova-compute[76442]: </disk>
Nov 14 21:01:39 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4cd80b-d2f4-43a7-97e8-59da8922bf52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3] added
Nov 14 21:01:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee32e87-aefb-45b7-b36d-b465acb41801]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c5da45-d583-4aec-b7b5-113a56baa243]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v terkOdVP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v terkOdVP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[767f7944-a939-4707-afd0-0ab1215aea8d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'terkOdVP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[650c0c6b-7801-4a4c-b2eb-950b0e07567d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4707d7-feee-4363-84e6-645e59b05a8d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:01:39 user nova-compute[76442]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)
Nov 14 21:01:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:01:39 user nova-compute[76442]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)
Nov 14 21:01:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No VIF found with MAC fa:16:3e:d3:e4:04, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:01:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f9b787ff-5fe5-4197-b4f8-0b695e1138e2 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.345s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --login" returned: 0 in 1.054s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9d0362-e886-4610-b59f-efeb47cc50fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3, portal: 172.16.0.220,3260]
Nov 14 21:01:40 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3, portal: 172.16.0.220,3260] successful.
Nov 14 21:01:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae443c9-caf8-452a-bcf4-f212b636515f]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb54670-51fc-46b1-82a1-9cb7b54cc3b2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:01:40 user nova-compute[76442]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)
Nov 14 21:01:40 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:01:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:01:40 user nova-compute[76442]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)
Nov 14 21:01:40 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:01:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.270s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d314706-0e8f-4f47-ba2e-6899ae0cdff1]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:01:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'terkOdVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.308s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== connect_volume: return (3386ms) {'type': 'block', 'scsi_wwn': '26232613965336232', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232613965336232', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1212644720',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1212644720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1212644720',id=46,image_ref='4c2d1c22-cc52-451b-ac76-de1434d052a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxGnP5lZBvf4nx2LyGdPRqN8d05LkMzcX3OJk6WkMMB5+oFx/OtyhK1m15s6P4oWUGd5CoO1C2ngXu6ui9gzS6MfSUFwFp+BAzGiUFyNEGdlyF88PghQOl5Eg/5S7i2Kw==',key_name='tempest-keypair-619122509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-f4mbndhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-792728264',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:01:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:87:42,bridge_name='br-int',has_traffic_filtering=True,id=f29ab2cf-b520-4dca-a385-33b81aff087c,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29ab2cf-b5') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.objects.instance [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:01:41 user nova-compute[76442]:   <uuid>0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc</uuid>
Nov 14 21:01:41 user nova-compute[76442]:   <name>instance-0000002e</name>
Nov 14 21:01:41 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:01:41 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:01:41 user nova-compute[76442]:   <metadata>
Nov 14 21:01:41 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:01:41 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:01:41 user nova-compute[76442]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1212644720</nova:name>
Nov 14 21:01:41 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:01:37</nova:creationTime>
Nov 14 21:01:41 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:01:41 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:01:41 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:01:41 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:01:41 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:01:41 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:01:41 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:01:41 user nova-compute[76442]:       <nova:owner>
Nov 14 21:01:41 user nova-compute[76442]:         <nova:user uuid="85f2d3fa02ad4ccbb286f49b8e59563d">tempest-TestVolumeBootPattern-792728264-project-member</nova:user>
Nov 14 21:01:41 user nova-compute[76442]:         <nova:project uuid="bcaf0b599d7c4224be5cab0f23b95157">tempest-TestVolumeBootPattern-792728264</nova:project>
Nov 14 21:01:41 user nova-compute[76442]:       </nova:owner>
Nov 14 21:01:41 user nova-compute[76442]:       <nova:root type="image" uuid="4c2d1c22-cc52-451b-ac76-de1434d052a6"/>
Nov 14 21:01:41 user nova-compute[76442]:       <nova:ports>
Nov 14 21:01:41 user nova-compute[76442]:         <nova:port uuid="f29ab2cf-b520-4dca-a385-33b81aff087c">
Nov 14 21:01:41 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 21:01:41 user nova-compute[76442]:         </nova:port>
Nov 14 21:01:41 user nova-compute[76442]:       </nova:ports>
Nov 14 21:01:41 user nova-compute[76442]:     </nova:instance>
Nov 14 21:01:41 user nova-compute[76442]:   </metadata>
Nov 14 21:01:41 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:01:41 user nova-compute[76442]:     <system>
Nov 14 21:01:41 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:01:41 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:01:41 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:01:41 user nova-compute[76442]:       <entry name="serial">0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc</entry>
Nov 14 21:01:41 user nova-compute[76442]:       <entry name="uuid">0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc</entry>
Nov 14 21:01:41 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:01:41 user nova-compute[76442]:     </system>
Nov 14 21:01:41 user nova-compute[76442]:   </sysinfo>
Nov 14 21:01:41 user nova-compute[76442]:   <os>
Nov 14 21:01:41 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:01:41 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:01:41 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:01:41 user nova-compute[76442]:   </os>
Nov 14 21:01:41 user nova-compute[76442]:   <features>
Nov 14 21:01:41 user nova-compute[76442]:     <acpi/>
Nov 14 21:01:41 user nova-compute[76442]:     <apic/>
Nov 14 21:01:41 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:01:41 user nova-compute[76442]:   </features>
Nov 14 21:01:41 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:01:41 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:01:41 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:01:41 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:01:41 user nova-compute[76442]:   </clock>
Nov 14 21:01:41 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:01:41 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:01:41 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:01:41 user nova-compute[76442]:   </cpu>
Nov 14 21:01:41 user nova-compute[76442]:   <devices>
Nov 14 21:01:41 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 21:01:41 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:01:41 user nova-compute[76442]:       <source dev="/dev/sdd"/>
Nov 14 21:01:41 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:01:41 user nova-compute[76442]:       <serial>a867541c-d4cd-451c-b511-54187d7c63f3</serial>
Nov 14 21:01:41 user nova-compute[76442]:     </disk>
Nov 14 21:01:41 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:01:41 user nova-compute[76442]:       <mac address="fa:16:3e:9d:87:42"/>
Nov 14 21:01:41 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:01:41 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:01:41 user nova-compute[76442]:       <target dev="tapf29ab2cf-b5"/>
Nov 14 21:01:41 user nova-compute[76442]:     </interface>
Nov 14 21:01:41 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:01:41 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc/console.log" append="off"/>
Nov 14 21:01:41 user nova-compute[76442]:     </serial>
Nov 14 21:01:41 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:01:41 user nova-compute[76442]:     <video>
Nov 14 21:01:41 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:01:41 user nova-compute[76442]:     </video>
Nov 14 21:01:41 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:01:41 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:01:41 user nova-compute[76442]:     </rng>
Nov 14 21:01:41 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:01:41 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:01:41 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:01:41 user nova-compute[76442]:     </memballoon>
Nov 14 21:01:41 user nova-compute[76442]:   </devices>
Nov 14 21:01:41 user nova-compute[76442]: </domain>
Nov 14 21:01:41 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1212644720',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1212644720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1212644720',id=46,image_ref='4c2d1c22-cc52-451b-ac76-de1434d052a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxGnP5lZBvf4nx2LyGdPRqN8d05LkMzcX3OJk6WkMMB5+oFx/OtyhK1m15s6P4oWUGd5CoO1C2ngXu6ui9gzS6MfSUFwFp+BAzGiUFyNEGdlyF88PghQOl5Eg/5S7i2Kw==',key_name='tempest-keypair-619122509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-f4mbndhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-792728264',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:01:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:87:42,bridge_name='br-int',has_traffic_filtering=True,id=f29ab2cf-b520-4dca-a385-33b81aff087c,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29ab2cf-b5') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG os_vif [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:87:42,bridge_name='br-int',has_traffic_filtering=True,id=f29ab2cf-b520-4dca-a385-33b81aff087c,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29ab2cf-b5') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7046fbda-33ad-5609-92a9-6a0217a37861', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf29ab2cf-b5, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf29ab2cf-b5, col_values=(('qos', UUID('37ee77b5-52cc-4751-bba6-faae239d7012')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf29ab2cf-b5, col_values=(('external_ids', {'iface-id': 'f29ab2cf-b520-4dca-a385-33b81aff087c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:87:42', 'vm-uuid': '0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:41 user nova-compute[76442]: INFO os_vif [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:87:42,bridge_name='br-int',has_traffic_filtering=True,id=f29ab2cf-b520-4dca-a385-33b81aff087c,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29ab2cf-b5')
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No VIF found with MAC fa:16:3e:9d:87:42, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:41 user nova-compute[76442]: INFO nova.compute.manager [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Detaching volume f606f01c-2e06-43e9-a4a0-616a52f038f6
Nov 14 21:01:41 user nova-compute[76442]: INFO nova.virt.block_device [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attempting to driver detach volume f606f01c-2e06-43e9-a4a0-616a52f038f6 from mountpoint /dev/vdb
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Attempting to detach device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:01:41 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:01:41 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:01:41 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:01:41 user nova-compute[76442]:   <serial>f606f01c-2e06-43e9-a4a0-616a52f038f6</serial>
Nov 14 21:01:41 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:01:41 user nova-compute[76442]: </disk>
Nov 14 21:01:41 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:01:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully detached device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the persistent domain config.
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 21:01:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:01:41 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:01:41 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:01:41 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:01:41 user nova-compute[76442]:   <serial>f606f01c-2e06-43e9-a4a0-616a52f038f6</serial>
Nov 14 21:01:41 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:01:41 user nova-compute[76442]: </disk>
Nov 14 21:01:41 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-68974f29-417d-49de-9f5f-8ab7b77821a3 req-92f16b25-b782-4b29-8630-6412dbb8e9cb service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received event network-changed-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG nova.compute.manager [req-68974f29-417d-49de-9f5f-8ab7b77821a3 req-92f16b25-b782-4b29-8630-6412dbb8e9cb service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Refreshing instance network info cache due to event network-changed-3894d600-3c72-4f8b-ba0c-d79b2519ecf5. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-68974f29-417d-49de-9f5f-8ab7b77821a3 req-92f16b25-b782-4b29-8630-6412dbb8e9cb service nova] Acquiring lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-68974f29-417d-49de-9f5f-8ab7b77821a3 req-92f16b25-b782-4b29-8630-6412dbb8e9cb service nova] Acquired lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG nova.network.neutron [req-68974f29-417d-49de-9f5f-8ab7b77821a3 req-92f16b25-b782-4b29-8630-6412dbb8e9cb service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Refreshing network info cache for port 3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:42 user nova-compute[76442]: INFO nova.compute.manager [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Terminating instance
Nov 14 21:01:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-ad440295-0b4d-4287-8fee-39f4c86c02dc req-4f0bfb40-a628-4637-bd83-80d50330611e service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received event network-vif-unplugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ad440295-0b4d-4287-8fee-39f4c86c02dc req-4f0bfb40-a628-4637-bd83-80d50330611e service nova] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ad440295-0b4d-4287-8fee-39f4c86c02dc req-4f0bfb40-a628-4637-bd83-80d50330611e service nova] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ad440295-0b4d-4287-8fee-39f4c86c02dc req-4f0bfb40-a628-4637-bd83-80d50330611e service nova] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-ad440295-0b4d-4287-8fee-39f4c86c02dc req-4f0bfb40-a628-4637-bd83-80d50330611e service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] No waiting events found dispatching network-vif-unplugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.compute.manager [req-ad440295-0b4d-4287-8fee-39f4c86c02dc req-4f0bfb40-a628-4637-bd83-80d50330611e service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received event network-vif-unplugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.network.neutron [req-68974f29-417d-49de-9f5f-8ab7b77821a3 req-92f16b25-b782-4b29-8630-6412dbb8e9cb service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updated VIF entry in instance network info cache for port 3894d600-3c72-4f8b-ba0c-d79b2519ecf5. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.network.neutron [req-68974f29-417d-49de-9f5f-8ab7b77821a3 req-92f16b25-b782-4b29-8630-6412dbb8e9cb service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updating instance_info_cache with network_info: [{"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-68974f29-417d-49de-9f5f-8ab7b77821a3 req-92f16b25-b782-4b29-8630-6412dbb8e9cb service nova] Releasing lock "refresh_cache-72f09c08-c10c-4449-941f-4dd5c9737d43" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:01:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Instance destroyed successfully.
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.objects.instance [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lazy-loading 'resources' on Instance uuid 72f09c08-c10c-4449-941f-4dd5c9737d43 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-119008924',display_name='tempest-TestStampPattern-server-119008924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-119008924',id=40,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvdINDy4N0nCmsxw9+z0YuoH3ORFDVbievK0y+5u+iZAsq6JkSs0vSSkOTyVGZyPAbS/GlayoYiP7LELDfKg0H397As/3cvk8b3zQIt0rEeH8Jo8IjV+llgBEk0dkVVig==',key_name='tempest-TestStampPattern-1089595662',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:54:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b7ef39084aa4d8faaeb192c1eaf6874',ramdisk_id='',reservation_id='r-oyww4q1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-369137228',owner_user_name='tempest-TestStampPattern-369137228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:57:52Z,user_data=None,user_id='64183849e82a427ea2e034ad39c70374',uuid=72f09c08-c10c-4449-941f-4dd5c9737d43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converting VIF {"id": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "address": "fa:16:3e:e5:21:46", "network": {"id": "41402819-14d2-4f44-8cfe-5a837805f809", "bridge": "br-int", "label": "tempest-TestStampPattern-957610687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b7ef39084aa4d8faaeb192c1eaf6874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3894d600-3c", "ovs_interfaceid": "3894d600-3c72-4f8b-ba0c-d79b2519ecf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:21:46,bridge_name='br-int',has_traffic_filtering=True,id=3894d600-3c72-4f8b-ba0c-d79b2519ecf5,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3894d600-3c') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG os_vif [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:21:46,bridge_name='br-int',has_traffic_filtering=True,id=3894d600-3c72-4f8b-ba0c-d79b2519ecf5,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3894d600-3c') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3894d600-3c, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1512d43-0ced-48b2-8ef8-c5ce29691ded) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:43 user nova-compute[76442]: INFO os_vif [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:21:46,bridge_name='br-int',has_traffic_filtering=True,id=3894d600-3c72-4f8b-ba0c-d79b2519ecf5,network=Network(41402819-14d2-4f44-8cfe-5a837805f809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3894d600-3c')
Nov 14 21:01:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Deleting instance files /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43_del
Nov 14 21:01:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Deletion of /opt/stack/data/nova/instances/72f09c08-c10c-4449-941f-4dd5c9737d43_del complete
Nov 14 21:01:43 user nova-compute[76442]: INFO nova.compute.manager [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 21:01:43 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:01:43 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:01:44 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Took 0.43 seconds to deallocate network for instance.
Nov 14 21:01:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-99966e8e-8036-4970-8ebf-672c94adc656 req-387552ee-bf9a-42cb-83dd-7e247fa29e0d service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received event network-vif-deleted-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:44 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Deleted allocations for instance 72f09c08-c10c-4449-941f-4dd5c9737d43
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-12da3946-d523-4265-938e-7699e5c6636a tempest-TestStampPattern-369137228 tempest-TestStampPattern-369137228-project-member] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.699s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received event network-vif-plugged-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] Acquiring lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] No waiting events found dispatching network-vif-plugged-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:44 user nova-compute[76442]: WARNING nova.compute.manager [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received unexpected event network-vif-plugged-f29ab2cf-b520-4dca-a385-33b81aff087c for instance with vm_state building and task_state spawning.
Nov 14 21:01:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received event network-vif-plugged-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] Acquiring lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] No waiting events found dispatching network-vif-plugged-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:44 user nova-compute[76442]: WARNING nova.compute.manager [req-f9dd7531-d13a-47b0-9a6e-d0053cce50c0 req-7d2f94ea-c87e-40f9-8d37-915c323c51a2 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received unexpected event network-vif-plugged-f29ab2cf-b520-4dca-a385-33b81aff087c for instance with vm_state building and task_state spawning.
Nov 14 21:01:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-6e99f358-9c16-40cb-8f79-babbc733fdc3 req-b796f5db-f58b-41be-ab14-3585f3419700 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received event network-vif-plugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6e99f358-9c16-40cb-8f79-babbc733fdc3 req-b796f5db-f58b-41be-ab14-3585f3419700 service nova] Acquiring lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6e99f358-9c16-40cb-8f79-babbc733fdc3 req-b796f5db-f58b-41be-ab14-3585f3419700 service nova] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6e99f358-9c16-40cb-8f79-babbc733fdc3 req-b796f5db-f58b-41be-ab14-3585f3419700 service nova] Lock "72f09c08-c10c-4449-941f-4dd5c9737d43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-6e99f358-9c16-40cb-8f79-babbc733fdc3 req-b796f5db-f58b-41be-ab14-3585f3419700 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] No waiting events found dispatching network-vif-plugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:45 user nova-compute[76442]: WARNING nova.compute.manager [req-6e99f358-9c16-40cb-8f79-babbc733fdc3 req-b796f5db-f58b-41be-ab14-3585f3419700 service nova] [instance: 72f09c08-c10c-4449-941f-4dd5c9737d43] Received unexpected event network-vif-plugged-3894d600-3c72-4f8b-ba0c-d79b2519ecf5 for instance with vm_state deleted and task_state None.
Nov 14 21:01:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:01:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:01:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Instance spawned successfully.
Nov 14 21:01:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 21:01:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:01:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:01:45 user nova-compute[76442]: INFO nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Took 7.64 seconds to spawn the instance on the hypervisor.
Nov 14 21:01:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:01:45 user nova-compute[76442]: INFO nova.compute.manager [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Took 22.80 seconds to build instance.
Nov 14 21:01:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-00d42c38-857e-491a-bc15-004a91290006 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.910s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.666s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:45 user nova-compute[76442]: INFO nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 14 21:01:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-92461ea7-db9a-4089-9f19-732646ca1017 req-db57405a-7257-47bc-af32-dec867d5e45a service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-changed-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-92461ea7-db9a-4089-9f19-732646ca1017 req-db57405a-7257-47bc-af32-dec867d5e45a service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Refreshing instance network info cache due to event network-changed-53a0cd1a-030f-45b9-8f40-0e15dd5b214d. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:01:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-92461ea7-db9a-4089-9f19-732646ca1017 req-db57405a-7257-47bc-af32-dec867d5e45a service nova] Acquiring lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:01:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-92461ea7-db9a-4089-9f19-732646ca1017 req-db57405a-7257-47bc-af32-dec867d5e45a service nova] Acquired lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:01:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-92461ea7-db9a-4089-9f19-732646ca1017 req-db57405a-7257-47bc-af32-dec867d5e45a service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Refreshing network info cache for port 53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:01:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-92461ea7-db9a-4089-9f19-732646ca1017 req-db57405a-7257-47bc-af32-dec867d5e45a service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updated VIF entry in instance network info cache for port 53a0cd1a-030f-45b9-8f40-0e15dd5b214d. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:01:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-92461ea7-db9a-4089-9f19-732646ca1017 req-db57405a-7257-47bc-af32-dec867d5e45a service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating instance_info_cache with network_info: [{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:01:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-92461ea7-db9a-4089-9f19-732646ca1017 req-db57405a-7257-47bc-af32-dec867d5e45a service nova] Releasing lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:01:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:49 user nova-compute[76442]: INFO nova.compute.manager [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Shelving
Nov 14 21:01:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-9d9d08bf-bafe-49a5-adc9-3291f42db9a9 req-44648491-c9fb-4132-afad-613ddea166e3 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-unplugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9d9d08bf-bafe-49a5-adc9-3291f42db9a9 req-44648491-c9fb-4132-afad-613ddea166e3 service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9d9d08bf-bafe-49a5-adc9-3291f42db9a9 req-44648491-c9fb-4132-afad-613ddea166e3 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9d9d08bf-bafe-49a5-adc9-3291f42db9a9 req-44648491-c9fb-4132-afad-613ddea166e3 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-9d9d08bf-bafe-49a5-adc9-3291f42db9a9 req-44648491-c9fb-4132-afad-613ddea166e3 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-unplugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:49 user nova-compute[76442]: WARNING nova.compute.manager [req-9d9d08bf-bafe-49a5-adc9-3291f42db9a9 req-44648491-c9fb-4132-afad-613ddea166e3 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-unplugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state active and task_state shelving.
Nov 14 21:01:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance destroyed successfully.
Nov 14 21:01:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Beginning cold snapshot process
Nov 14 21:01:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:50 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 21:01:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk /opt/stack/data/nova/instances/snapshots/tmpxx2ainqd/9e676ba1db26487d8e954f0f27cdada0 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:01:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk /opt/stack/data/nova/instances/snapshots/tmpxx2ainqd/9e676ba1db26487d8e954f0f27cdada0" returned: 0 in 0.538s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:01:51 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Snapshot extracted, beginning image upload
Nov 14 21:01:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:52 user nova-compute[76442]: WARNING nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:52 user nova-compute[76442]: WARNING nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:52 user nova-compute[76442]: WARNING nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-unplugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-unplugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:52 user nova-compute[76442]: WARNING nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-unplugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:01:52 user nova-compute[76442]: WARNING nova.compute.manager [req-63db2ff7-f3e0-46a5-97e6-e881b632f057 req-65898b62-ee5e-4bfb-8475-2a22bcda4bbb service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 21:01:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Snapshot image upload complete
Nov 14 21:01:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:01:53 user nova-compute[76442]: INFO nova.compute.manager [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Shelve offloading
Nov 14 21:01:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance destroyed successfully.
Nov 14 21:01:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:01:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:01:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquired lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:01:53 user nova-compute[76442]: DEBUG nova.network.neutron [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:01:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating instance_info_cache with network_info: [{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:01:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Releasing lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:01:55 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance destroyed successfully.
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.objects.instance [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'resources' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1421805467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1421805467',id=45,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcINiknkA7aCqomMgBZc2X1SnwUEE99VoWXMBQMiNMXVJy/UWIx41ju+rCyyf0a0z11bGtRnTS4EXA/kDRJlG9gRDVlMSgDaZZJ88A96cRYhM1XXtIAGlTgQdZseusryg==',key_name='tempest-keypair-2143665200',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-5vkspjq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member',shelved_at='2023-11-14T21:01:53.844633',shelved_host='user',shelved_image_id='8f07b4ef-f8bd-4c19-8867-086db48fb2d7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:01:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=63f99719-dcf0-4296-8c1b-8cbed44869c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG os_vif [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53a0cd1a-03, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-7668745d-2a5b-42c5-a2e8-d715a7e13591 req-3e637dcc-7a37-468f-8566-35a505ef3348 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-changed-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-7668745d-2a5b-42c5-a2e8-d715a7e13591 req-3e637dcc-7a37-468f-8566-35a505ef3348 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Refreshing instance network info cache due to event network-changed-53a0cd1a-030f-45b9-8f40-0e15dd5b214d. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7668745d-2a5b-42c5-a2e8-d715a7e13591 req-3e637dcc-7a37-468f-8566-35a505ef3348 service nova] Acquiring lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7668745d-2a5b-42c5-a2e8-d715a7e13591 req-3e637dcc-7a37-468f-8566-35a505ef3348 service nova] Acquired lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-7668745d-2a5b-42c5-a2e8-d715a7e13591 req-3e637dcc-7a37-468f-8566-35a505ef3348 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Refreshing network info cache for port 53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34f44051-799c-40b2-a4d7-634df968196f) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:01:55 user nova-compute[76442]: INFO os_vif [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03')
Nov 14 21:01:55 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Deleting instance files /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6_del
Nov 14 21:01:55 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Deletion of /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6_del complete
Nov 14 21:01:55 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Deleted allocations for instance 63f99719-dcf0-4296-8c1b-8cbed44869c6
Nov 14 21:01:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.objects.instance [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'numa_topology' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.objects.base [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<63f99719-dcf0-4296-8c1b-8cbed44869c6> lazy-loaded attributes: resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-7668745d-2a5b-42c5-a2e8-d715a7e13591 req-3e637dcc-7a37-468f-8566-35a505ef3348 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updated VIF entry in instance network info cache for port 53a0cd1a-030f-45b9-8f40-0e15dd5b214d. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-7668745d-2a5b-42c5-a2e8-d715a7e13591 req-3e637dcc-7a37-468f-8566-35a505ef3348 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating instance_info_cache with network_info: [{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7668745d-2a5b-42c5-a2e8-d715a7e13591 req-3e637dcc-7a37-468f-8566-35a505ef3348 service nova] Releasing lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:01:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-958dd673-fb30-42aa-87bf-bd3e734453ce tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.119s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:01:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:02 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 is timed out.
Nov 14 21:02:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully detached device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the live domain config.
Nov 14 21:02:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAdHcKNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:02:02 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[343978cf-685c-4aaf-9e6b-3eb85285ca4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:02:02 user nova-compute[76442]: No targets found.
Nov 14 21:02:02 user nova-compute[76442]: iSNS:
Nov 14 21:02:02 user nova-compute[76442]: No targets found.
Nov 14 21:02:02 user nova-compute[76442]: STATIC:
Nov 14 21:02:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819
Nov 14 21:02:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:02:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:02:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6
Nov 14 21:02:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:02:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:02:02 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3
Nov 14 21:02:02 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:02:02 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:02:02 user nova-compute[76442]: FIRMWARE:
Nov 14 21:02:02 user nova-compute[76442]: No targets found.
Nov 14 21:02:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:02:02 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:02:02 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c140a864-963c-4595-99bc-f556cb85c548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fe208e-56b2-439e-a525-cf92a2610280]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:02:02 user nova-compute[76442]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)
Nov 14 21:02:02 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:02:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:02:02 user nova-compute[76442]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 (non-flash)
Nov 14 21:02:02 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:02:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e8533be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[65179e2f-4e3a-48f7-a71e-fecc58d0dd07]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deac8d1-0f33-434e-bfda-42afa1d4e079]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f081e-057b-4517-91ef-58c4126ae33a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa50cf-97dd-4f5c-87ba-a19710079081]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[041c10f9-f0cd-44c9-b4ce-c95089179381]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3371399a-667d-411f-90b8-895e0830cd25]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6, portal: 172.16.0.220,3260]
Nov 14 21:02:02 user nova-compute[76442]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6, portal: 172.16.0.220,3260] successful.
Nov 14 21:02:02 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f606f01c-2e06-43e9-a4a0-616a52f038f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[018dc8f0-2ae1-41ac-8577-9f294733ca4a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== disconnect_volume: return (317ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:02:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:03 user nova-compute[76442]: DEBUG nova.objects.instance [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:02:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-cf34fb46-ba1c-416c-9c36-5473b33b0c30 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:02:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:17 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:02:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:18 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:02:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:02:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:02:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:02:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:02:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:02:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:02:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:02:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:02:23 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updating instance_info_cache with network_info: [{"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-1e294e17-c14e-427a-a302-11fcf10e8438" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:24 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:25 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:02:25 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:02:25 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.144683837890625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance bf56558d-23ef-4fe7-859c-6120ec5e6587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 1e294e17-c14e-427a-a302-11fcf10e8438 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:02:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:02:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:02:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:02:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:02:33 user nova-compute[76442]: INFO nova.compute.manager [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attaching volume cf09e631-08dd-4801-801e-7457b17344a1 to /dev/vdb
Nov 14 21:02:33 user nova-compute[76442]: DEBUG os_brick.utils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76912f0-bf50-4503-bec8-14ab647d610d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:33 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[362a71d3-a973-4214-99d2-0b8fb69d4660]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71719ad-058c-493f-b9d2-13f417323661]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b87bdd-614e-4255-ba54-a57dea5f5161]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:02:34 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:02:34 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6765e55d-e589-4b8b-a646-bf65c92d1703]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG os_brick.utils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:02:34 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating existing volume attachment record: 5d485794-edc3-400a-b55f-84db3fb49530 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:02:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:02:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grdxVDQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:02:39 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:02:39 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:02:39 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c69112-91a3-415b-a04d-9b78fd214485]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:02:39 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa161e-0557-429f-a854-dd19093a9cfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1] added
Nov 14 21:02:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d60533c-ee59-4a8d-bb77-e41489cf2def]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[230cdab4-efff-4ac4-8e8f-7a7284cb6aee]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grdxVDQt {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grdxVDQt" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e168e5-b13b-472a-b09a-e79aaa7ab365]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grdxVDQt'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6018aa1-d48f-4078-a9c8-4def4918905e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[09938c21-cd82-4585-ab3d-24aa7eae552a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[666a8a4b-aec2-4f24-9c20-ed594b2f83ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1, portal: 172.16.0.220,3260]
Nov 14 21:02:39 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1, portal: 172.16.0.220,3260] successful.
Nov 14 21:02:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8689ba-210d-40c7-9a09-b227f0d9a084]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ca2db8-98d6-4397-84ab-d9319c449038]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 (non-flash)
Nov 14 21:02:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f96a34d-6209-4579-9a38-33343e646e37]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:02:39 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grdxVDQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23132343665313461', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132343665313461', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 21:02:40 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:02:40 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:02:40 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:02:40 user nova-compute[76442]:   <serial>cf09e631-08dd-4801-801e-7457b17344a1</serial>
Nov 14 21:02:40 user nova-compute[76442]: </disk>
Nov 14 21:02:40 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:02:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No VIF found with MAC fa:16:3e:d3:e4:04, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:02:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-8688112a-0cad-451f-b36d-6fb87a1d99a3 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.104s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:02:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:02:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:02:42 user nova-compute[76442]: INFO nova.compute.manager [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Detaching volume cf09e631-08dd-4801-801e-7457b17344a1
Nov 14 21:02:43 user nova-compute[76442]: INFO nova.virt.block_device [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attempting to driver detach volume cf09e631-08dd-4801-801e-7457b17344a1 from mountpoint /dev/vdb
Nov 14 21:02:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Attempting to detach device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 21:02:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:02:43 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:02:43 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:02:43 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:02:43 user nova-compute[76442]:   <serial>cf09e631-08dd-4801-801e-7457b17344a1</serial>
Nov 14 21:02:43 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:02:43 user nova-compute[76442]: </disk>
Nov 14 21:02:43 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:02:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully detached device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the persistent domain config.
Nov 14 21:02:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 21:02:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:02:43 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:02:43 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:02:43 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:02:43 user nova-compute[76442]:   <serial>cf09e631-08dd-4801-801e-7457b17344a1</serial>
Nov 14 21:02:43 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:02:43 user nova-compute[76442]: </disk>
Nov 14 21:02:43 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:02:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 21:02:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:02:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:03:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:03:03 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 is timed out.
Nov 14 21:03:03 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully detached device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the live domain config.
Nov 14 21:03:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grdxVDQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:03:03 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ec43d1-13c0-44de-9a02-4b1ad54faf22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:03:03 user nova-compute[76442]: No targets found.
Nov 14 21:03:03 user nova-compute[76442]: iSNS:
Nov 14 21:03:03 user nova-compute[76442]: No targets found.
Nov 14 21:03:03 user nova-compute[76442]: STATIC:
Nov 14 21:03:03 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819
Nov 14 21:03:03 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:03:03 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:03:03 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1
Nov 14 21:03:03 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:03:03 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:03:03 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3
Nov 14 21:03:03 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:03:03 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:03:03 user nova-compute[76442]: FIRMWARE:
Nov 14 21:03:03 user nova-compute[76442]: No targets found.
Nov 14 21:03:03 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:03:03 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:03:03 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[083e6ad9-30e7-4214-8bd6-c7c7e041f808]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa03064-3b54-4f49-ad20-e97539ce1ba2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:03 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:03:03 user nova-compute[76442]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 (non-flash)
Nov 14 21:03:03 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:03 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:03:03 user nova-compute[76442]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 (non-flash)
Nov 14 21:03:03 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f070c4570a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba7607-b849-4bc3-9540-da2c222d4394]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7177ef-9209-4fdf-8081-d5528106d257]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbab066-b246-41e5-ac5e-46e95663a10b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[43540fc5-2017-482c-93da-199137dac841]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba817a2c-21d3-407d-88e8-c815f81c90c4]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[59192f15-83e4-43b5-92ca-5fe104e87a01]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1, portal: 172.16.0.220,3260]
Nov 14 21:03:03 user nova-compute[76442]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1, portal: 172.16.0.220,3260] successful.
Nov 14 21:03:03 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf09e631-08dd-4801-801e-7457b17344a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4821eed-4ccd-42c0-a745-3f3ce55d596b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== disconnect_volume: return (293ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:03:03 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:03:04 user nova-compute[76442]: DEBUG nova.objects.instance [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-e402e7cd-2c6f-413f-8d1d-4179075c857d tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.591s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-6d75d1d1-39bc-4715-9701-9ba346eedd27 req-6a1aba66-d6cc-4d48-aad0-d160f1a96af4 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received event network-changed-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:03:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-6d75d1d1-39bc-4715-9701-9ba346eedd27 req-6a1aba66-d6cc-4d48-aad0-d160f1a96af4 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Refreshing instance network info cache due to event network-changed-f29ab2cf-b520-4dca-a385-33b81aff087c. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:03:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6d75d1d1-39bc-4715-9701-9ba346eedd27 req-6a1aba66-d6cc-4d48-aad0-d160f1a96af4 service nova] Acquiring lock "refresh_cache-0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:03:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6d75d1d1-39bc-4715-9701-9ba346eedd27 req-6a1aba66-d6cc-4d48-aad0-d160f1a96af4 service nova] Acquired lock "refresh_cache-0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:03:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-6d75d1d1-39bc-4715-9701-9ba346eedd27 req-6a1aba66-d6cc-4d48-aad0-d160f1a96af4 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Refreshing network info cache for port f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG nova.network.neutron [req-6d75d1d1-39bc-4715-9701-9ba346eedd27 req-6a1aba66-d6cc-4d48-aad0-d160f1a96af4 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Updated VIF entry in instance network info cache for port f29ab2cf-b520-4dca-a385-33b81aff087c. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG nova.network.neutron [req-6d75d1d1-39bc-4715-9701-9ba346eedd27 req-6a1aba66-d6cc-4d48-aad0-d160f1a96af4 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Updating instance_info_cache with network_info: [{"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6d75d1d1-39bc-4715-9701-9ba346eedd27 req-6a1aba66-d6cc-4d48-aad0-d160f1a96af4 service nova] Releasing lock "refresh_cache-0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:14 user nova-compute[76442]: INFO nova.compute.manager [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Terminating instance
Nov 14 21:03:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:14 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Instance destroyed successfully.
Nov 14 21:03:14 user nova-compute[76442]: DEBUG nova.objects.instance [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'resources' on Instance uuid 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1212644720',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1212644720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1212644720',id=46,image_ref='4c2d1c22-cc52-451b-ac76-de1434d052a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxGnP5lZBvf4nx2LyGdPRqN8d05LkMzcX3OJk6WkMMB5+oFx/OtyhK1m15s6P4oWUGd5CoO1C2ngXu6ui9gzS6MfSUFwFp+BAzGiUFyNEGdlyF88PghQOl5Eg/5S7i2Kw==',key_name='tempest-keypair-619122509',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-f4mbndhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-792728264',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:01:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "f29ab2cf-b520-4dca-a385-33b81aff087c", "address": "fa:16:3e:9d:87:42", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf29ab2cf-b5", "ovs_interfaceid": "f29ab2cf-b520-4dca-a385-33b81aff087c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:87:42,bridge_name='br-int',has_traffic_filtering=True,id=f29ab2cf-b520-4dca-a385-33b81aff087c,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29ab2cf-b5') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_vif [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:87:42,bridge_name='br-int',has_traffic_filtering=True,id=f29ab2cf-b520-4dca-a385-33b81aff087c,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29ab2cf-b5') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf29ab2cf-b5, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37ee77b5-52cc-4751-bba6-faae239d7012) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:15 user nova-compute[76442]: INFO os_vif [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:87:42,bridge_name='br-int',has_traffic_filtering=True,id=f29ab2cf-b520-4dca-a385-33b81aff087c,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf29ab2cf-b5')
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'terkOdVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:03:15 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2403d19-b2a8-4abf-8aad-89b992c502e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:03:15 user nova-compute[76442]: No targets found.
Nov 14 21:03:15 user nova-compute[76442]: iSNS:
Nov 14 21:03:15 user nova-compute[76442]: No targets found.
Nov 14 21:03:15 user nova-compute[76442]: STATIC:
Nov 14 21:03:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819
Nov 14 21:03:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:03:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:03:15 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3
Nov 14 21:03:15 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:03:15 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:03:15 user nova-compute[76442]: FIRMWARE:
Nov 14 21:03:15 user nova-compute[76442]: No targets found.
Nov 14 21:03:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:03:15 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:03:15 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ecc2bf-c1ae-433b-9d9e-90ac0fa67055]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[491e060a-1506-46f6-bbc0-c814e9016729]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:15 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:03:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:15 user nova-compute[76442]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 (non-flash)
Nov 14 21:03:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e848bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[424af975-0ba7-4257-bc73-f881aa5fa5a7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caf2864-7700-42aa-8fa4-3feae9d54d89]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78cb3d4-a6ff-4c36-95ae-d4be4ff5a155]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[213a20db-3397-40e8-b352-d956c1eee7f6]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f042cf8-857d-4765-bc4d-fd3afbdd3c72]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1305795d-30d2-4bc3-a58d-159033df91ef]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3, portal: 172.16.0.220,3260]
Nov 14 21:03:15 user nova-compute[76442]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3, portal: 172.16.0.220,3260] successful.
Nov 14 21:03:15 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a867541c-d4cd-451c-b511-54187d7c63f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f05875-3dd4-4e92-a96d-5aa5213230f9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== disconnect_volume: return (313ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:03:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Deleting instance files /opt/stack/data/nova/instances/0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc_del
Nov 14 21:03:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Deletion of /opt/stack/data/nova/instances/0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc_del complete
Nov 14 21:03:15 user nova-compute[76442]: INFO nova.compute.manager [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received event network-vif-unplugged-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] Acquiring lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] No waiting events found dispatching network-vif-unplugged-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received event network-vif-unplugged-f29ab2cf-b520-4dca-a385-33b81aff087c for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received event network-vif-plugged-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] Acquiring lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] No waiting events found dispatching network-vif-plugged-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:03:15 user nova-compute[76442]: WARNING nova.compute.manager [req-339e71b1-a918-4561-bcdf-997e96babefa req-0863881b-b98d-4ea1-96d7-e1fde452c93c service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received unexpected event network-vif-plugged-f29ab2cf-b520-4dca-a385-33b81aff087c for instance with vm_state active and task_state deleting.
Nov 14 21:03:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:16 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:03:16 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Took 0.62 seconds to deallocate network for instance.
Nov 14 21:03:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-8093ee5d-0d5b-4ab6-a31c-865297b733ae req-e59dc381-585f-4508-bcc6-7eaa73fa3a82 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Received event network-vif-deleted-f29ab2cf-b520-4dca-a385-33b81aff087c {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:03:16 user nova-compute[76442]: INFO nova.compute.manager [req-8093ee5d-0d5b-4ab6-a31c-865297b733ae req-e59dc381-585f-4508-bcc6-7eaa73fa3a82 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Neutron deleted interface f29ab2cf-b520-4dca-a385-33b81aff087c; detaching it from the instance and deleting it from the info cache
Nov 14 21:03:16 user nova-compute[76442]: DEBUG nova.network.neutron [req-8093ee5d-0d5b-4ab6-a31c-865297b733ae req-e59dc381-585f-4508-bcc6-7eaa73fa3a82 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:03:16 user nova-compute[76442]: DEBUG nova.compute.manager [req-8093ee5d-0d5b-4ab6-a31c-865297b733ae req-e59dc381-585f-4508-bcc6-7eaa73fa3a82 service nova] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Detach interface failed, port_id=f29ab2cf-b520-4dca-a385-33b81aff087c, reason: Instance 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 21:03:16 user nova-compute[76442]: INFO nova.compute.manager [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 21:03:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc] Deleting volume: a867541c-d4cd-451c-b511-54187d7c63f3 {{(pid=76442) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 21:03:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:17 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:03:17 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:03:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:17 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Deleted allocations for instance 0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc
Nov 14 21:03:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-0318de45-903c-4c0a-bff8-2f73f3eb5b08 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "0dba1cd1-f3c1-4d53-82f4-8e8c8c7c51cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.981s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:18 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:03:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:03:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Skipping network cache update for instance because it has been migrated to another host. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 14 21:03:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:27 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:03:27 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:03:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.14275360107422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance bf56558d-23ef-4fe7-859c-6120ec5e6587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 1e294e17-c14e-427a-a302-11fcf10e8438 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:03:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG nova.objects.instance [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:35 user nova-compute[76442]: INFO nova.compute.manager [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attaching volume a98fed08-e65e-4f9e-823f-690fe1b1bed3 to /dev/vdb
Nov 14 21:03:35 user nova-compute[76442]: DEBUG os_brick.utils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6653532-b49b-44b7-9103-3090faa7bdf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee75df-a37a-4654-b1f3-fdb3ed19b90f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f13112a-6b1e-4e1a-a59b-42178f0836ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c61e9a0-30fd-459d-bbbb-7c08c279228a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:03:35 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:03:35 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55eb3a-6bd6-4321-aab8-f7c7c7d79b16]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG os_brick.utils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:03:35 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating existing volume attachment record: 489e8717-fbcd-4745-bf0d-c0e0351a1376 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:03:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBwFfHbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:03:39 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:03:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:03:39 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:03:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:03:39 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f87910a-3527-44a8-85b3-01ecc1c708e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:03:39 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b27d34-f9fa-4999-8497-f2c0dfc57e67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3] added
Nov 14 21:03:39 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c161eca-d982-46af-a307-0785c121710d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e899dcfb-fb8e-4eea-9da8-2fc822ff990c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBwFfHbn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBwFfHbn" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d44f513-19e8-404e-86cc-5a4e1e2cbb84]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vBwFfHbn'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c629f991-3796-493d-a5d3-ed5a96333397]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c463fa-139f-4f2d-9e79-2eae16c54ff7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d3f1b9-631f-49e6-b920-c37805942dbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3, portal: 172.16.0.220,3260]
Nov 14 21:03:40 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3, portal: 172.16.0.220,3260] successful.
Nov 14 21:03:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed4cd58-26cc-41f2-bf9f-be5bb0078512]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bb57fc-56d9-4f48-8d25-417da516bd33]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:40 user nova-compute[76442]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)
Nov 14 21:03:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:40 user nova-compute[76442]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)
Nov 14 21:03:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[97267564-d23a-42af-8511-1f8b2db4d084]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBwFfHbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26263363532383061', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263363532383061', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG nova.objects.instance [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 21:03:41 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:03:41 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:03:41 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:03:41 user nova-compute[76442]:   <serial>a98fed08-e65e-4f9e-823f-690fe1b1bed3</serial>
Nov 14 21:03:41 user nova-compute[76442]: </disk>
Nov 14 21:03:41 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] No VIF found with MAC fa:16:3e:d3:e4:04, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-130ce05d-2d2a-47b5-aeca-70e85986f124 tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.360s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:41 user nova-compute[76442]: INFO nova.compute.manager [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Unshelving
Nov 14 21:03:42 user nova-compute[76442]: INFO nova.virt.block_device [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Booting with volume ce8e3d02-199b-493c-8ec0-efb3a5606177 at /dev/vdc
Nov 14 21:03:42 user nova-compute[76442]: DEBUG os_brick.utils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5835363-a81e-4064-b9bd-99e029aa98c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a38ffb1-71ac-431e-8a3d-30a4b4e46f46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc61355-66d3-4b37-8efe-c9695ebcb520]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a1abd4-96f3-4cab-911a-56dfb4c06957]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:03:42 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:03:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b5a2de-af2a-4fc3-a151-046346676964]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG os_brick.utils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating existing volume attachment record: d9771099-a8f5-485a-ae23-9565e9b66dad {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:03:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:43 user nova-compute[76442]: INFO nova.compute.manager [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Detaching volume a98fed08-e65e-4f9e-823f-690fe1b1bed3
Nov 14 21:03:43 user nova-compute[76442]: INFO nova.virt.block_device [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Attempting to driver detach volume a98fed08-e65e-4f9e-823f-690fe1b1bed3 from mountpoint /dev/vdb
Nov 14 21:03:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Attempting to detach device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 21:03:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:03:43 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:03:43 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:03:43 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:03:43 user nova-compute[76442]:   <serial>a98fed08-e65e-4f9e-823f-690fe1b1bed3</serial>
Nov 14 21:03:43 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:03:43 user nova-compute[76442]: </disk>
Nov 14 21:03:43 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:03:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully detached device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the persistent domain config.
Nov 14 21:03:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 21:03:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:03:43 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:03:43 user nova-compute[76442]:   <source dev="/dev/sdc"/>
Nov 14 21:03:43 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:03:43 user nova-compute[76442]:   <serial>a98fed08-e65e-4f9e-823f-690fe1b1bed3</serial>
Nov 14 21:03:43 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:03:43 user nova-compute[76442]: </disk>
Nov 14 21:03:43 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:03:44 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 21:03:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:46 user nova-compute[76442]: DEBUG nova.objects.instance [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'pci_requests' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:46 user nova-compute[76442]: DEBUG nova.objects.instance [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'numa_topology' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:46 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:03:46 user nova-compute[76442]: INFO nova.compute.claims [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Claim successful on node user
Nov 14 21:03:46 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:03:46 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:03:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:46 user nova-compute[76442]: INFO nova.network.neutron [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating port 53a0cd1a-030f-45b9-8f40-0e15dd5b214d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquired lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG nova.network.neutron [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-57954980-a403-476c-b8a2-e481de1f72a5 req-6715853f-2116-4e31-a759-5152d09ef7d1 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-changed-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG nova.compute.manager [req-57954980-a403-476c-b8a2-e481de1f72a5 req-6715853f-2116-4e31-a759-5152d09ef7d1 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Refreshing instance network info cache due to event network-changed-53a0cd1a-030f-45b9-8f40-0e15dd5b214d. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57954980-a403-476c-b8a2-e481de1f72a5 req-6715853f-2116-4e31-a759-5152d09ef7d1 service nova] Acquiring lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG nova.network.neutron [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating instance_info_cache with network_info: [{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Releasing lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:03:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Creating image(s)
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57954980-a403-476c-b8a2-e481de1f72a5 req-6715853f-2116-4e31-a759-5152d09ef7d1 service nova] Acquired lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG nova.network.neutron [req-57954980-a403-476c-b8a2-e481de1f72a5 req-6715853f-2116-4e31-a759-5152d09ef7d1 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Refreshing network info cache for port 53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG nova.objects.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<63f99719-dcf0-4296-8c1b-8cbed44869c6> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "76a89d36026077b342946c339898432faed956e8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "76a89d36026077b342946c339898432faed956e8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8.part --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:48 user nova-compute[76442]: DEBUG nova.virt.images [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] 8f07b4ef-f8bd-4c19-8867-086db48fb2d7 was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 21:03:48 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 21:03:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8.part /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:49 user nova-compute[76442]: DEBUG nova.network.neutron [req-57954980-a403-476c-b8a2-e481de1f72a5 req-6715853f-2116-4e31-a759-5152d09ef7d1 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updated VIF entry in instance network info cache for port 53a0cd1a-030f-45b9-8f40-0e15dd5b214d. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:03:49 user nova-compute[76442]: DEBUG nova.network.neutron [req-57954980-a403-476c-b8a2-e481de1f72a5 req-6715853f-2116-4e31-a759-5152d09ef7d1 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating instance_info_cache with network_info: [{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:03:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-57954980-a403-476c-b8a2-e481de1f72a5 req-6715853f-2116-4e31-a759-5152d09ef7d1 service nova] Releasing lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:03:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8.part /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8.converted" returned: 0 in 0.749s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "76a89d36026077b342946c339898432faed956e8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.054s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8 --force-share --output=json" returned: 0 in 0.192s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "76a89d36026077b342946c339898432faed956e8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "76a89d36026077b342946c339898432faed956e8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8 --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8,backing_fmt=raw /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8,backing_fmt=raw /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk 1073741824" returned: 0 in 0.045s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "76a89d36026077b342946c339898432faed956e8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8 --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG nova.objects.instance [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'migration_context' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG nova.objects.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<63f99719-dcf0-4296-8c1b-8cbed44869c6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:03:50 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Rebasing disk image.
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.181s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:50 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 -F raw /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 -F raw /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk" returned: 0 in 1.953s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Ensure instance console log exists: /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Start _get_guest_xml network_info=[{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='77f3570c735c74f244140516c01f4ed6',container_format='bare',created_at=2023-11-14T21:01:50Z,direct_url=<?>,disk_format='qcow2',id=8f07b4ef-f8bd-4c19-8867-086db48fb2d7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1421805467-shelved',owner='04176df08b194d959611acf480360493',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T21:01:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUFxDpAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '63f99719-dcf0-4296-8c1b-8cbed44869c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce8e3d02-199b-493c-8ec0-efb3a5606177', 'serial': 'ce8e3d02-199b-493c-8ec0-efb3a5606177'}, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'attachment_id': 'd9771099-a8f5-485a-ae23-9565e9b66dad', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:03:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:03:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='77f3570c735c74f244140516c01f4ed6',container_format='bare',created_at=2023-11-14T21:01:50Z,direct_url=<?>,disk_format='qcow2',id=8f07b4ef-f8bd-4c19-8867-086db48fb2d7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1421805467-shelved',owner='04176df08b194d959611acf480360493',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T21:01:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.objects.instance [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.objects.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<63f99719-dcf0-4296-8c1b-8cbed44869c6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUFxDpAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:03:52 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:03:52 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:03:52 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6f309c-1269-4a85-9edc-c93538c6bf58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:03:52 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a757220a-88c5-4e6e-991a-7ceb14037a57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177] added
Nov 14 21:03:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85ba097-f8c2-4946-bf4d-497e428745ae]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b65f529-4853-4834-a85c-b6a4ca0e3f55]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUFxDpAC {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUFxDpAC" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfeb716-f6b5-42c0-83cd-c76f48601516]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tUFxDpAC'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[653e7dfc-b832-4ba1-bb7c-9220bfcc7f9c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cac9d08-b4e2-4a19-aeaa-34fe784f7ab9]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:52 user nova-compute[76442]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)
Nov 14 21:03:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:52 user nova-compute[76442]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)
Nov 14 21:03:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd167209-a4c0-4238-ac0a-d84229ab8995]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177, portal: 172.16.0.220,3260]
Nov 14 21:03:52 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177, portal: 172.16.0.220,3260] successful.
Nov 14 21:03:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[338786be-e55e-4e4c-8e76-aa835adad493]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:03:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dcd6b2-5973-4b9d-aa99-01ba96e489bf]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:53 user nova-compute[76442]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)
Nov 14 21:03:53 user nova-compute[76442]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:03:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:03:53 user nova-compute[76442]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)
Nov 14 21:03:53 user nova-compute[76442]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:03:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4ea198-aece-4f1c-b06d-ce7289d07fbc]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:03:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUFxDpAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23530346362393931', 'path': '/dev/sdd'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530346362393931', 'path': '/dev/sdd'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1421805467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1421805467',id=45,image_ref='8f07b4ef-f8bd-4c19-8867-086db48fb2d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2143665200',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-5vkspjq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member',shelved_at='2023-11-14T21:01:53.844633',shelved_host='user',shelved_image_id='8f07b4ef-f8bd-4c19-8867-086db48fb2d7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=63f99719-dcf0-4296-8c1b-8cbed44869c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.objects.instance [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'pci_devices' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.objects.base [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<63f99719-dcf0-4296-8c1b-8cbed44869c6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:03:54 user nova-compute[76442]:   <uuid>63f99719-dcf0-4296-8c1b-8cbed44869c6</uuid>
Nov 14 21:03:54 user nova-compute[76442]:   <name>instance-0000002d</name>
Nov 14 21:03:54 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:03:54 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:03:54 user nova-compute[76442]:   <metadata>
Nov 14 21:03:54 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:03:54 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:03:54 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1421805467</nova:name>
Nov 14 21:03:54 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:03:52</nova:creationTime>
Nov 14 21:03:54 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:03:54 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:03:54 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:03:54 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:03:54 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:03:54 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:03:54 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:03:54 user nova-compute[76442]:       <nova:owner>
Nov 14 21:03:54 user nova-compute[76442]:         <nova:user uuid="eb9d2e0b8d7b4bdf94872e2186dfad31">tempest-AttachVolumeShelveTestJSON-1848978120-project-member</nova:user>
Nov 14 21:03:54 user nova-compute[76442]:         <nova:project uuid="04176df08b194d959611acf480360493">tempest-AttachVolumeShelveTestJSON-1848978120</nova:project>
Nov 14 21:03:54 user nova-compute[76442]:       </nova:owner>
Nov 14 21:03:54 user nova-compute[76442]:       <nova:root type="image" uuid="8f07b4ef-f8bd-4c19-8867-086db48fb2d7"/>
Nov 14 21:03:54 user nova-compute[76442]:       <nova:ports>
Nov 14 21:03:54 user nova-compute[76442]:         <nova:port uuid="53a0cd1a-030f-45b9-8f40-0e15dd5b214d">
Nov 14 21:03:54 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 21:03:54 user nova-compute[76442]:         </nova:port>
Nov 14 21:03:54 user nova-compute[76442]:       </nova:ports>
Nov 14 21:03:54 user nova-compute[76442]:     </nova:instance>
Nov 14 21:03:54 user nova-compute[76442]:   </metadata>
Nov 14 21:03:54 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:03:54 user nova-compute[76442]:     <system>
Nov 14 21:03:54 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:03:54 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:03:54 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:03:54 user nova-compute[76442]:       <entry name="serial">63f99719-dcf0-4296-8c1b-8cbed44869c6</entry>
Nov 14 21:03:54 user nova-compute[76442]:       <entry name="uuid">63f99719-dcf0-4296-8c1b-8cbed44869c6</entry>
Nov 14 21:03:54 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:03:54 user nova-compute[76442]:     </system>
Nov 14 21:03:54 user nova-compute[76442]:   </sysinfo>
Nov 14 21:03:54 user nova-compute[76442]:   <os>
Nov 14 21:03:54 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:03:54 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:03:54 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:03:54 user nova-compute[76442]:   </os>
Nov 14 21:03:54 user nova-compute[76442]:   <features>
Nov 14 21:03:54 user nova-compute[76442]:     <acpi/>
Nov 14 21:03:54 user nova-compute[76442]:     <apic/>
Nov 14 21:03:54 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:03:54 user nova-compute[76442]:   </features>
Nov 14 21:03:54 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:03:54 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:03:54 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:03:54 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:03:54 user nova-compute[76442]:   </clock>
Nov 14 21:03:54 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:03:54 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:03:54 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:03:54 user nova-compute[76442]:   </cpu>
Nov 14 21:03:54 user nova-compute[76442]:   <devices>
Nov 14 21:03:54 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 21:03:54 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 21:03:54 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk"/>
Nov 14 21:03:54 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:03:54 user nova-compute[76442]:     </disk>
Nov 14 21:03:54 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 21:03:54 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:03:54 user nova-compute[76442]:       <source dev="/dev/sdd"/>
Nov 14 21:03:54 user nova-compute[76442]:       <target dev="vdc" bus="virtio"/>
Nov 14 21:03:54 user nova-compute[76442]:       <serial>ce8e3d02-199b-493c-8ec0-efb3a5606177</serial>
Nov 14 21:03:54 user nova-compute[76442]:     </disk>
Nov 14 21:03:54 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:03:54 user nova-compute[76442]:       <mac address="fa:16:3e:f5:2d:50"/>
Nov 14 21:03:54 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:03:54 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:03:54 user nova-compute[76442]:       <target dev="tap53a0cd1a-03"/>
Nov 14 21:03:54 user nova-compute[76442]:     </interface>
Nov 14 21:03:54 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:03:54 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/console.log" append="off"/>
Nov 14 21:03:54 user nova-compute[76442]:     </serial>
Nov 14 21:03:54 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:03:54 user nova-compute[76442]:     <video>
Nov 14 21:03:54 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:03:54 user nova-compute[76442]:     </video>
Nov 14 21:03:54 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:03:54 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:03:54 user nova-compute[76442]:     </rng>
Nov 14 21:03:54 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:03:54 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:03:54 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:03:54 user nova-compute[76442]:     </memballoon>
Nov 14 21:03:54 user nova-compute[76442]:   </devices>
Nov 14 21:03:54 user nova-compute[76442]: </domain>
Nov 14 21:03:54 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1421805467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1421805467',id=45,image_ref='8f07b4ef-f8bd-4c19-8867-086db48fb2d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2143665200',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-5vkspjq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member',shelved_at='2023-11-14T21:01:53.844633',shelved_host='user',shelved_image_id='8f07b4ef-f8bd-4c19-8867-086db48fb2d7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=63f99719-dcf0-4296-8c1b-8cbed44869c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG os_vif [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e05f96a-1ef4-54fc-80f3-1df99c186cdf', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53a0cd1a-03, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53a0cd1a-03, col_values=(('qos', UUID('66bb5a00-2d4e-4575-9793-4d1a58fa5630')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53a0cd1a-03, col_values=(('external_ids', {'iface-id': '53a0cd1a-030f-45b9-8f40-0e15dd5b214d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:2d:50', 'vm-uuid': '63f99719-dcf0-4296-8c1b-8cbed44869c6'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:54 user nova-compute[76442]: INFO os_vif [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03')
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:03:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] No VIF found with MAC fa:16:3e:f5:2d:50, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:03:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-d30575d2-7011-418e-9cf6-e27ef1fb82f3 req-fb335899-9503-418d-acbd-f9dc4a637475 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:03:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d30575d2-7011-418e-9cf6-e27ef1fb82f3 req-fb335899-9503-418d-acbd-f9dc4a637475 service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d30575d2-7011-418e-9cf6-e27ef1fb82f3 req-fb335899-9503-418d-acbd-f9dc4a637475 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d30575d2-7011-418e-9cf6-e27ef1fb82f3 req-fb335899-9503-418d-acbd-f9dc4a637475 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-d30575d2-7011-418e-9cf6-e27ef1fb82f3 req-fb335899-9503-418d-acbd-f9dc4a637475 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:03:55 user nova-compute[76442]: WARNING nova.compute.manager [req-d30575d2-7011-418e-9cf6-e27ef1fb82f3 req-fb335899-9503-418d-acbd-f9dc4a637475 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 21:03:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:03:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:03:57 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance spawned successfully.
Nov 14 21:03:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-f09c6cec-39dc-4823-a20d-e9944202e5d2 req-64840ca8-2c88-4bf3-9880-04a33aa8f853 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:03:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f09c6cec-39dc-4823-a20d-e9944202e5d2 req-64840ca8-2c88-4bf3-9880-04a33aa8f853 service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:03:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f09c6cec-39dc-4823-a20d-e9944202e5d2 req-64840ca8-2c88-4bf3-9880-04a33aa8f853 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:03:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f09c6cec-39dc-4823-a20d-e9944202e5d2 req-64840ca8-2c88-4bf3-9880-04a33aa8f853 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-f09c6cec-39dc-4823-a20d-e9944202e5d2 req-64840ca8-2c88-4bf3-9880-04a33aa8f853 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:03:57 user nova-compute[76442]: WARNING nova.compute.manager [req-f09c6cec-39dc-4823-a20d-e9944202e5d2 req-64840ca8-2c88-4bf3-9880-04a33aa8f853 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 21:03:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:03:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:03:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-47d9ea56-390d-48b7-8c97-8c3260ea86fd tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:03:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:04 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 is timed out.
Nov 14 21:04:04 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully detached device vdb from instance bf56558d-23ef-4fe7-859c-6120ec5e6587 from the live domain config.
Nov 14 21:04:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBwFfHbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:04:04 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8570fe5-57d5-471f-803a-06dc31141345]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:04:04 user nova-compute[76442]: No targets found.
Nov 14 21:04:04 user nova-compute[76442]: iSNS:
Nov 14 21:04:04 user nova-compute[76442]: No targets found.
Nov 14 21:04:04 user nova-compute[76442]: STATIC:
Nov 14 21:04:04 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819
Nov 14 21:04:04 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:04:04 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:04:04 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3
Nov 14 21:04:04 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:04:04 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:04:04 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177
Nov 14 21:04:04 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:04:04 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:04:04 user nova-compute[76442]: FIRMWARE:
Nov 14 21:04:04 user nova-compute[76442]: No targets found.
Nov 14 21:04:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:04:04 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:04:04 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[67142c05-edff-4af0-9fff-b2025fe920ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[475b6b50-7ec3-4534-9a95-73fcff4e2a90]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:04:04 user nova-compute[76442]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)
Nov 14 21:04:04 user nova-compute[76442]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:04:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:04:04 user nova-compute[76442]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 (non-flash)
Nov 14 21:04:04 user nova-compute[76442]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:04:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4fec160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ca07ee-5680-4201-b830-501eacf71904]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e1abcc-de42-4973-a6e4-dd24d01db4e5]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f42aae-948a-49c7-b68c-b4cc3afd7195]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b82328d-08e9-4acf-813c-2d547a5b971f]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[00715015-c965-4321-8087-ac1689125f38]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.174s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dc6d7a-9bf4-4488-9f2c-12019455c4c6]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3, portal: 172.16.0.220,3260]
Nov 14 21:04:04 user nova-compute[76442]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3, portal: 172.16.0.220,3260] successful.
Nov 14 21:04:04 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a98fed08-e65e-4f9e-823f-690fe1b1bed3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd2ccf4-5f57-4c49-ab76-0e038a49aad5]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] <== disconnect_volume: return (399ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:04:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "1e294e17-c14e-427a-a302-11fcf10e8438" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:05 user nova-compute[76442]: INFO nova.compute.manager [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Terminating instance
Nov 14 21:04:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG nova.objects.instance [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'flavor' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-ca0a7da5-d965-4113-9d04-f98628e92eac tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.405s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-574b2142-ed54-4c59-8fc6-218aa31ba466 req-17051aa1-59a3-41ee-abef-437caabeeb6d service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-unplugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-574b2142-ed54-4c59-8fc6-218aa31ba466 req-17051aa1-59a3-41ee-abef-437caabeeb6d service nova] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-574b2142-ed54-4c59-8fc6-218aa31ba466 req-17051aa1-59a3-41ee-abef-437caabeeb6d service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-574b2142-ed54-4c59-8fc6-218aa31ba466 req-17051aa1-59a3-41ee-abef-437caabeeb6d service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-574b2142-ed54-4c59-8fc6-218aa31ba466 req-17051aa1-59a3-41ee-abef-437caabeeb6d service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] No waiting events found dispatching network-vif-unplugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.compute.manager [req-574b2142-ed54-4c59-8fc6-218aa31ba466 req-17051aa1-59a3-41ee-abef-437caabeeb6d service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-unplugged-a667547a-b001-4a96-a8fa-9cc318543e16 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Instance destroyed successfully.
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'resources' on Instance uuid 1e294e17-c14e-427a-a302-11fcf10e8438 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:59:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-529778262',display_name='tempest-TestVolumeBootPattern-volume-backed-server-529778262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-529778262',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxLO1ahTdCiXDYFdTuotD1+dV5qOpGGQ2qeoj8Ek718jpRkc+XLz7ZmayhleP/d1uJH6eAY3Tbj/OrQSsuXLvunqGQ4IGaXj4ryMsJmMbiRPMFEkZvAa6p0ZmJ3ySVztA==',key_name='tempest-keypair-99483608',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:59:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-6wn9jxkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=1e294e17-c14e-427a-a302-11fcf10e8438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "a667547a-b001-4a96-a8fa-9cc318543e16", "address": "fa:16:3e:4f:6b:57", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa667547a-b0", "ovs_interfaceid": "a667547a-b001-4a96-a8fa-9cc318543e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6b:57,bridge_name='br-int',has_traffic_filtering=True,id=a667547a-b001-4a96-a8fa-9cc318543e16,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa667547a-b0') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_vif [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6b:57,bridge_name='br-int',has_traffic_filtering=True,id=a667547a-b001-4a96-a8fa-9cc318543e16,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa667547a-b0') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa667547a-b0, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a42665d3-a417-469d-ac3d-5dee611fc886) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:06 user nova-compute[76442]: INFO os_vif [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6b:57,bridge_name='br-int',has_traffic_filtering=True,id=a667547a-b001-4a96-a8fa-9cc318543e16,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa667547a-b0')
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buDoJfIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:04:06 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0810d7-f3d0-45d9-85da-970d7839d04c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:04:06 user nova-compute[76442]: No targets found.
Nov 14 21:04:06 user nova-compute[76442]: iSNS:
Nov 14 21:04:06 user nova-compute[76442]: No targets found.
Nov 14 21:04:06 user nova-compute[76442]: STATIC:
Nov 14 21:04:06 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819
Nov 14 21:04:06 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:04:06 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:04:06 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177
Nov 14 21:04:06 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:04:06 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:04:06 user nova-compute[76442]: FIRMWARE:
Nov 14 21:04:06 user nova-compute[76442]: No targets found.
Nov 14 21:04:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:04:06 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:04:06 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e93ed03-847e-4a7c-8673-b4fa8a7c65de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c77d02e-89e3-4ae4-aab5-53bb9f0f80b3]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:04:06 user nova-compute[76442]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:04:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 (non-flash)
Nov 14 21:04:06 user nova-compute[76442]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:04:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e85311b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f59365c-b697-47ce-b66c-ec56e5ccc14a]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[724f0ed9-d7f5-4345-b530-f58515578944]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368e053-2dba-491f-a6e1-38480ab9f846]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0492b951-1e4b-48ed-ae10-b8713cf28d37]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9aabd6-348c-4cd6-956c-a277c4eb825b]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fba9ea5-f12a-47f5-893d-765b13eb5159]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819, portal: 172.16.0.220,3260]
Nov 14 21:04:06 user nova-compute[76442]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819, portal: 172.16.0.220,3260] successful.
Nov 14 21:04:06 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0a8f3e-4b79-4282-af0b-b1c92eb92819 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4948031a-b7e6-4b2b-8d12-b43e75c71c9c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== disconnect_volume: return (318ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:04:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Deleting instance files /opt/stack/data/nova/instances/1e294e17-c14e-427a-a302-11fcf10e8438_del
Nov 14 21:04:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Deletion of /opt/stack/data/nova/instances/1e294e17-c14e-427a-a302-11fcf10e8438_del complete
Nov 14 21:04:06 user nova-compute[76442]: INFO nova.compute.manager [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 21:04:06 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:04:06 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:04:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:07 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:04:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-88ce7bc2-2a74-4027-a30f-c73e0a7b7d4c req-3923a104-f818-41ee-a4ba-39172fe01271 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-deleted-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:07 user nova-compute[76442]: INFO nova.compute.manager [req-88ce7bc2-2a74-4027-a30f-c73e0a7b7d4c req-3923a104-f818-41ee-a4ba-39172fe01271 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Neutron deleted interface a667547a-b001-4a96-a8fa-9cc318543e16; detaching it from the instance and deleting it from the info cache
Nov 14 21:04:07 user nova-compute[76442]: DEBUG nova.network.neutron [req-88ce7bc2-2a74-4027-a30f-c73e0a7b7d4c req-3923a104-f818-41ee-a4ba-39172fe01271 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:04:07 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Took 0.70 seconds to deallocate network for instance.
Nov 14 21:04:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-88ce7bc2-2a74-4027-a30f-c73e0a7b7d4c req-3923a104-f818-41ee-a4ba-39172fe01271 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Detach interface failed, port_id=a667547a-b001-4a96-a8fa-9cc318543e16, reason: Instance 1e294e17-c14e-427a-a302-11fcf10e8438 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] No waiting events found dispatching network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:04:08 user nova-compute[76442]: WARNING nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received unexpected event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 for instance with vm_state active and task_state deleting.
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] No waiting events found dispatching network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:04:08 user nova-compute[76442]: WARNING nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received unexpected event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 for instance with vm_state active and task_state deleting.
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] No waiting events found dispatching network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:04:08 user nova-compute[76442]: WARNING nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received unexpected event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 for instance with vm_state active and task_state deleting.
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-unplugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] No waiting events found dispatching network-vif-unplugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-unplugged-a667547a-b001-4a96-a8fa-9cc318543e16 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Acquiring lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] Lock "1e294e17-c14e-427a-a302-11fcf10e8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] No waiting events found dispatching network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:04:08 user nova-compute[76442]: WARNING nova.compute.manager [req-2ef190e2-6db3-4837-bbbb-f249cdb52666 req-d4e1e7d0-a8e4-4a05-bc39-71782106d103 service nova] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Received unexpected event network-vif-plugged-a667547a-b001-4a96-a8fa-9cc318543e16 for instance with vm_state active and task_state deleting.
Nov 14 21:04:08 user nova-compute[76442]: INFO nova.compute.manager [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.manager [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 1e294e17-c14e-427a-a302-11fcf10e8438] Deleting volume: bc0a8f3e-4b79-4282-af0b-b1c92eb92819 {{(pid=76442) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:08 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Deleted allocations for instance 1e294e17-c14e-427a-a302-11fcf10e8438
Nov 14 21:04:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-6c349b12-0c06-442f-b4fe-57c9bf6f6e4a tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "1e294e17-c14e-427a-a302-11fcf10e8438" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.075s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:18 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:04:20 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:04:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:04:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:04:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:04:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:04:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:04:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:04:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:04:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:04:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:04:26 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:04:26 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:04:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating instance_info_cache with network_info: [{"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-bf56558d-23ef-4fe7-859c-6120ec5e6587" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:04:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:04:28 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:04:28 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:04:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.115554809570312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance bf56558d-23ef-4fe7-859c-6120ec5e6587 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:04:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:04:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:04:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:04:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:04:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:04:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:04:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:46 user nova-compute[76442]: INFO nova.compute.manager [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Terminating instance
Nov 14 21:04:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-5bc8be86-37e5-4982-af80-e6b8dd9744ca req-3831fb63-ef72-49cd-b0c5-6a5bc636e099 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received event network-vif-unplugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5bc8be86-37e5-4982-af80-e6b8dd9744ca req-3831fb63-ef72-49cd-b0c5-6a5bc636e099 service nova] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5bc8be86-37e5-4982-af80-e6b8dd9744ca req-3831fb63-ef72-49cd-b0c5-6a5bc636e099 service nova] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5bc8be86-37e5-4982-af80-e6b8dd9744ca req-3831fb63-ef72-49cd-b0c5-6a5bc636e099 service nova] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-5bc8be86-37e5-4982-af80-e6b8dd9744ca req-3831fb63-ef72-49cd-b0c5-6a5bc636e099 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] No waiting events found dispatching network-vif-unplugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-5bc8be86-37e5-4982-af80-e6b8dd9744ca req-3831fb63-ef72-49cd-b0c5-6a5bc636e099 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received event network-vif-unplugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:04:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Instance destroyed successfully.
Nov 14 21:04:47 user nova-compute[76442]: DEBUG nova.objects.instance [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lazy-loading 'resources' on Instance uuid bf56558d-23ef-4fe7-859c-6120ec5e6587 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T20:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-785215681',display_name='tempest-SnapshotDataIntegrityTests-server-785215681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-785215681',id=43,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVOrRB3VpJ2/6pV2x8jZN5tJvXQvgMfm6d8LvHE9cdI9SC0jzUYJlvOn6ZceoFvvQ++TxmNLg87ObRcJMhLKhZ4HbemcHU8PtGuseCfBlGaP6mxSYXRxIMtwRdrKoQSNg==',key_name='tempest-keypair-1701235588',keypairs=<?>,launch_index=0,launched_at=2023-11-14T20:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2ac6ff974d04facaff0f6cee11e9a01',ramdisk_id='',reservation_id='r-fc4zs06z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2118105795',owner_user_name='tempest-SnapshotDataIntegrityTests-2118105795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T20:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='287213336c2a4de58d9a0508e1f13ae7',uuid=bf56558d-23ef-4fe7-859c-6120ec5e6587,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Converting VIF {"id": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "address": "fa:16:3e:d3:e4:04", "network": {"id": "a1387944-e2a3-4887-9fbb-eab53f78bbed", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1687982004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ac6ff974d04facaff0f6cee11e9a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd5032a6-56", "ovs_interfaceid": "cd5032a6-56b5-4ac4-9f94-34a1503d46bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:e4:04,bridge_name='br-int',has_traffic_filtering=True,id=cd5032a6-56b5-4ac4-9f94-34a1503d46bb,network=Network(a1387944-e2a3-4887-9fbb-eab53f78bbed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd5032a6-56') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG os_vif [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:e4:04,bridge_name='br-int',has_traffic_filtering=True,id=cd5032a6-56b5-4ac4-9f94-34a1503d46bb,network=Network(a1387944-e2a3-4887-9fbb-eab53f78bbed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd5032a6-56') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd5032a6-56, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee4fdfeb-2adf-4423-bb5e-dd6cc7a7408e) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:04:47 user nova-compute[76442]: INFO os_vif [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:e4:04,bridge_name='br-int',has_traffic_filtering=True,id=cd5032a6-56b5-4ac4-9f94-34a1503d46bb,network=Network(a1387944-e2a3-4887-9fbb-eab53f78bbed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd5032a6-56')
Nov 14 21:04:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Deleting instance files /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587_del
Nov 14 21:04:47 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Deletion of /opt/stack/data/nova/instances/bf56558d-23ef-4fe7-859c-6120ec5e6587_del complete
Nov 14 21:04:47 user nova-compute[76442]: INFO nova.compute.manager [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 21:04:47 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:04:47 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-1d2ed687-067e-4544-b15a-55659ff2472d req-c3d9b356-fb12-412c-960f-f621f7fb0b23 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received event network-vif-deleted-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:48 user nova-compute[76442]: INFO nova.compute.manager [req-1d2ed687-067e-4544-b15a-55659ff2472d req-c3d9b356-fb12-412c-960f-f621f7fb0b23 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Neutron deleted interface cd5032a6-56b5-4ac4-9f94-34a1503d46bb; detaching it from the instance and deleting it from the info cache
Nov 14 21:04:48 user nova-compute[76442]: DEBUG nova.network.neutron [req-1d2ed687-067e-4544-b15a-55659ff2472d req-c3d9b356-fb12-412c-960f-f621f7fb0b23 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:04:48 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Took 0.73 seconds to deallocate network for instance.
Nov 14 21:04:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-1d2ed687-067e-4544-b15a-55659ff2472d req-c3d9b356-fb12-412c-960f-f621f7fb0b23 service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Detach interface failed, port_id=cd5032a6-56b5-4ac4-9f94-34a1503d46bb, reason: Instance bf56558d-23ef-4fe7-859c-6120ec5e6587 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:48 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Deleted allocations for instance bf56558d-23ef-4fe7-859c-6120ec5e6587
Nov 14 21:04:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-61499430-51de-48e3-8de1-e5d4ab9e76fb tempest-SnapshotDataIntegrityTests-2118105795 tempest-SnapshotDataIntegrityTests-2118105795-project-member] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.897s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-1fe85d8c-a0d8-405a-8a51-002452cac1f5 req-61ddfc28-1cb2-499d-907e-b107ffd4c9ae service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received event network-vif-plugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1fe85d8c-a0d8-405a-8a51-002452cac1f5 req-61ddfc28-1cb2-499d-907e-b107ffd4c9ae service nova] Acquiring lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1fe85d8c-a0d8-405a-8a51-002452cac1f5 req-61ddfc28-1cb2-499d-907e-b107ffd4c9ae service nova] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1fe85d8c-a0d8-405a-8a51-002452cac1f5 req-61ddfc28-1cb2-499d-907e-b107ffd4c9ae service nova] Lock "bf56558d-23ef-4fe7-859c-6120ec5e6587-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:04:48 user nova-compute[76442]: DEBUG nova.compute.manager [req-1fe85d8c-a0d8-405a-8a51-002452cac1f5 req-61ddfc28-1cb2-499d-907e-b107ffd4c9ae service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] No waiting events found dispatching network-vif-plugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:04:48 user nova-compute[76442]: WARNING nova.compute.manager [req-1fe85d8c-a0d8-405a-8a51-002452cac1f5 req-61ddfc28-1cb2-499d-907e-b107ffd4c9ae service nova] [instance: bf56558d-23ef-4fe7-859c-6120ec5e6587] Received unexpected event network-vif-plugged-cd5032a6-56b5-4ac4-9f94-34a1503d46bb for instance with vm_state deleted and task_state None.
Nov 14 21:04:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:04:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "78954580-ac3e-436f-894f-10c6c1f6994d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "78954580-ac3e-436f-894f-10c6c1f6994d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:05:03 user nova-compute[76442]: INFO nova.compute.claims [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Claim successful on node user
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.network.neutron [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 21:05:03 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.policy [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f2d3fa02ad4ccbb286f49b8e59563d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaf0b599d7c4224be5cab0f23b95157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 21:05:03 user nova-compute[76442]: INFO nova.virt.block_device [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Booting with volume 22c817b9-dda6-48ed-855a-5bfe80431d44 at /dev/vda
Nov 14 21:05:03 user nova-compute[76442]: DEBUG os_brick.utils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddf0df8-5edd-445a-8b54-016350ae2830]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eb5bad-2ad5-4f62-adf5-f04cfd7d711d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb87adf8-39a1-44b7-859a-c5aa93d8f3fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[173cd376-6f8e-4d19-ab2c-3d9b40ea7f6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:05:03 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:05:03 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f47642a-a388-47e8-be08-91e27d053d00]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG os_brick.utils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:05:03 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Updating existing volume attachment record: d17b138b-7dad-40b7-9943-d7bd14eebb7c {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:05:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Successfully created port: 88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 21:05:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Successfully updated port: 88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 21:05:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:05:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquired lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:05:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-3fcb6d24-773d-4480-abf9-c9dd96c1bab6 req-a394ec3d-3b4e-49c1-a630-d69ebee0fbea service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received event network-changed-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG nova.compute.manager [req-3fcb6d24-773d-4480-abf9-c9dd96c1bab6 req-a394ec3d-3b4e-49c1-a630-d69ebee0fbea service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Refreshing instance network info cache due to event network-changed-88c8fc6a-5761-477c-8ab2-9dd60a534f19. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3fcb6d24-773d-4480-abf9-c9dd96c1bab6 req-a394ec3d-3b4e-49c1-a630-d69ebee0fbea service nova] Acquiring lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG nova.network.neutron [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Updating instance_info_cache with network_info: [{"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Releasing lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Instance network_info: |[{"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3fcb6d24-773d-4480-abf9-c9dd96c1bab6 req-a394ec3d-3b4e-49c1-a630-d69ebee0fbea service nova] Acquired lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-3fcb6d24-773d-4480-abf9-c9dd96c1bab6 req-a394ec3d-3b4e-49c1-a630-d69ebee0fbea service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Refreshing network info cache for port 88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-3fcb6d24-773d-4480-abf9-c9dd96c1bab6 req-a394ec3d-3b4e-49c1-a630-d69ebee0fbea service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Updated VIF entry in instance network info cache for port 88c8fc6a-5761-477c-8ab2-9dd60a534f19. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-3fcb6d24-773d-4480-abf9-c9dd96c1bab6 req-a394ec3d-3b4e-49c1-a630-d69ebee0fbea service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Updating instance_info_cache with network_info: [{"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:05:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-3fcb6d24-773d-4480-abf9-c9dd96c1bab6 req-a394ec3d-3b4e-49c1-a630-d69ebee0fbea service nova] Releasing lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:05:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:05:09 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Creating image(s)
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Ensure instance console log exists: /opt/stack/data/nova/instances/78954580-ac3e-436f-894f-10c6c1f6994d/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Start _get_guest_xml network_info=[{"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoYMbnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78954580-ac3e-436f-894f-10c6c1f6994d', 'attached_at': '', 'detached_at': '', 'volume_id': '22c817b9-dda6-48ed-855a-5bfe80431d44', 'serial': '22c817b9-dda6-48ed-855a-5bfe80431d44'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'd17b138b-7dad-40b7-9943-d7bd14eebb7c', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:05:09 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:05:09 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoYMbnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:05:09 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:05:09 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:05:09 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd37d387-31f7-4564-9633-1e70f493514f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:05:09 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6382d3-d0b8-45ad-b855-2dc5acf1e56e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44] added
Nov 14 21:05:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1758067f-aa1b-43e1-83e5-818c3dd4481a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[36da4350-d9d3-4c86-89a6-39731cdefe16]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAoYMbnr {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAoYMbnr" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9942cae0-5cda-4b4e-8a06-28710027ea72]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FAoYMbnr'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[16107331-7e02-47a0-ae96-90b62f4365fa]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2617a8f5-383c-4fa3-894b-b2f93a632964]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:05:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:05:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8d2b0b-d3f5-4648-88a3-097d387e5caf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260]
Nov 14 21:05:09 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260] successful.
Nov 14 21:05:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5a0e13-3b75-4168-af67-3fa911477c11]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b791dd3-6724-4b58-889c-b2044f005384]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:05:09 user nova-compute[76442]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:05:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:05:09 user nova-compute[76442]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:05:09 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a058145-1268-4026-9e0d-b6019f90c6c3]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:05:09 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoYMbnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26563613231653436', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563613231653436', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-132875762',display_name='tempest-TestVolumeBootPattern-server-132875762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-132875762',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMqtgJcFo+NzjA+7zu6HEvMzvBBa7Tnf+vJ5z+1XXrfQbhOVQpKiDoQUweMd2Q4UWCll8fgk22nliL1Wnofn524UJjbOUqMcyJZsIShi3LXF6K6AvSqhcjKFsOqpiDXyA==',key_name='tempest-TestVolumeBootPattern-280068245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-bi23rq9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:05:04Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=78954580-ac3e-436f-894f-10c6c1f6994d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:6f:c5,bridge_name='br-int',has_traffic_filtering=True,id=88c8fc6a-5761-477c-8ab2-9dd60a534f19,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8fc6a-57') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.objects.instance [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'pci_devices' on Instance uuid 78954580-ac3e-436f-894f-10c6c1f6994d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:05:10 user nova-compute[76442]:   <uuid>78954580-ac3e-436f-894f-10c6c1f6994d</uuid>
Nov 14 21:05:10 user nova-compute[76442]:   <name>instance-0000002f</name>
Nov 14 21:05:10 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:05:10 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:05:10 user nova-compute[76442]:   <metadata>
Nov 14 21:05:10 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:05:10 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:05:10 user nova-compute[76442]:       <nova:name>tempest-TestVolumeBootPattern-server-132875762</nova:name>
Nov 14 21:05:10 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:05:09</nova:creationTime>
Nov 14 21:05:10 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:05:10 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:05:10 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:05:10 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:05:10 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:05:10 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:05:10 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:05:10 user nova-compute[76442]:       <nova:owner>
Nov 14 21:05:10 user nova-compute[76442]:         <nova:user uuid="85f2d3fa02ad4ccbb286f49b8e59563d">tempest-TestVolumeBootPattern-792728264-project-member</nova:user>
Nov 14 21:05:10 user nova-compute[76442]:         <nova:project uuid="bcaf0b599d7c4224be5cab0f23b95157">tempest-TestVolumeBootPattern-792728264</nova:project>
Nov 14 21:05:10 user nova-compute[76442]:       </nova:owner>
Nov 14 21:05:10 user nova-compute[76442]:       <nova:ports>
Nov 14 21:05:10 user nova-compute[76442]:         <nova:port uuid="88c8fc6a-5761-477c-8ab2-9dd60a534f19">
Nov 14 21:05:10 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 21:05:10 user nova-compute[76442]:         </nova:port>
Nov 14 21:05:10 user nova-compute[76442]:       </nova:ports>
Nov 14 21:05:10 user nova-compute[76442]:     </nova:instance>
Nov 14 21:05:10 user nova-compute[76442]:   </metadata>
Nov 14 21:05:10 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:05:10 user nova-compute[76442]:     <system>
Nov 14 21:05:10 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:05:10 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:05:10 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:05:10 user nova-compute[76442]:       <entry name="serial">78954580-ac3e-436f-894f-10c6c1f6994d</entry>
Nov 14 21:05:10 user nova-compute[76442]:       <entry name="uuid">78954580-ac3e-436f-894f-10c6c1f6994d</entry>
Nov 14 21:05:10 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:05:10 user nova-compute[76442]:     </system>
Nov 14 21:05:10 user nova-compute[76442]:   </sysinfo>
Nov 14 21:05:10 user nova-compute[76442]:   <os>
Nov 14 21:05:10 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:05:10 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:05:10 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:05:10 user nova-compute[76442]:   </os>
Nov 14 21:05:10 user nova-compute[76442]:   <features>
Nov 14 21:05:10 user nova-compute[76442]:     <acpi/>
Nov 14 21:05:10 user nova-compute[76442]:     <apic/>
Nov 14 21:05:10 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:05:10 user nova-compute[76442]:   </features>
Nov 14 21:05:10 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:05:10 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:05:10 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:05:10 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:05:10 user nova-compute[76442]:   </clock>
Nov 14 21:05:10 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:05:10 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:05:10 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:05:10 user nova-compute[76442]:   </cpu>
Nov 14 21:05:10 user nova-compute[76442]:   <devices>
Nov 14 21:05:10 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 21:05:10 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:05:10 user nova-compute[76442]:       <source dev="/dev/sdb"/>
Nov 14 21:05:10 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:05:10 user nova-compute[76442]:       <serial>22c817b9-dda6-48ed-855a-5bfe80431d44</serial>
Nov 14 21:05:10 user nova-compute[76442]:     </disk>
Nov 14 21:05:10 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:05:10 user nova-compute[76442]:       <mac address="fa:16:3e:1d:6f:c5"/>
Nov 14 21:05:10 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:05:10 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:05:10 user nova-compute[76442]:       <target dev="tap88c8fc6a-57"/>
Nov 14 21:05:10 user nova-compute[76442]:     </interface>
Nov 14 21:05:10 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:05:10 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/78954580-ac3e-436f-894f-10c6c1f6994d/console.log" append="off"/>
Nov 14 21:05:10 user nova-compute[76442]:     </serial>
Nov 14 21:05:10 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:05:10 user nova-compute[76442]:     <video>
Nov 14 21:05:10 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:05:10 user nova-compute[76442]:     </video>
Nov 14 21:05:10 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:05:10 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:05:10 user nova-compute[76442]:     </rng>
Nov 14 21:05:10 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:05:10 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:05:10 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:05:10 user nova-compute[76442]:     </memballoon>
Nov 14 21:05:10 user nova-compute[76442]:   </devices>
Nov 14 21:05:10 user nova-compute[76442]: </domain>
Nov 14 21:05:10 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-132875762',display_name='tempest-TestVolumeBootPattern-server-132875762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-132875762',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMqtgJcFo+NzjA+7zu6HEvMzvBBa7Tnf+vJ5z+1XXrfQbhOVQpKiDoQUweMd2Q4UWCll8fgk22nliL1Wnofn524UJjbOUqMcyJZsIShi3LXF6K6AvSqhcjKFsOqpiDXyA==',key_name='tempest-TestVolumeBootPattern-280068245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-bi23rq9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:05:04Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=78954580-ac3e-436f-894f-10c6c1f6994d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:6f:c5,bridge_name='br-int',has_traffic_filtering=True,id=88c8fc6a-5761-477c-8ab2-9dd60a534f19,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8fc6a-57') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG os_vif [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:6f:c5,bridge_name='br-int',has_traffic_filtering=True,id=88c8fc6a-5761-477c-8ab2-9dd60a534f19,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8fc6a-57') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c1db75f-34d6-5194-82ff-cbd9683c2af7', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88c8fc6a-57, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88c8fc6a-57, col_values=(('qos', UUID('5e071f17-d3b7-4b89-86bd-5ddecaf9352c')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88c8fc6a-57, col_values=(('external_ids', {'iface-id': '88c8fc6a-5761-477c-8ab2-9dd60a534f19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:6f:c5', 'vm-uuid': '78954580-ac3e-436f-894f-10c6c1f6994d'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:10 user nova-compute[76442]: INFO os_vif [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:6f:c5,bridge_name='br-int',has_traffic_filtering=True,id=88c8fc6a-5761-477c-8ab2-9dd60a534f19,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8fc6a-57')
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:05:10 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No VIF found with MAC fa:16:3e:1d:6f:c5, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:05:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-404d60c6-edef-42cc-995b-77b36e812e6f req-99d88782-d025-43bb-9c55-f6d641ad803d service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received event network-vif-plugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:05:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-404d60c6-edef-42cc-995b-77b36e812e6f req-99d88782-d025-43bb-9c55-f6d641ad803d service nova] Acquiring lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:05:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-404d60c6-edef-42cc-995b-77b36e812e6f req-99d88782-d025-43bb-9c55-f6d641ad803d service nova] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:05:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-404d60c6-edef-42cc-995b-77b36e812e6f req-99d88782-d025-43bb-9c55-f6d641ad803d service nova] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:05:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-404d60c6-edef-42cc-995b-77b36e812e6f req-99d88782-d025-43bb-9c55-f6d641ad803d service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] No waiting events found dispatching network-vif-plugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:05:12 user nova-compute[76442]: WARNING nova.compute.manager [req-404d60c6-edef-42cc-995b-77b36e812e6f req-99d88782-d025-43bb-9c55-f6d641ad803d service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received unexpected event network-vif-plugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 for instance with vm_state building and task_state spawning.
Nov 14 21:05:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:05:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:05:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Instance spawned successfully.
Nov 14 21:05:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 21:05:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:05:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:05:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:05:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:05:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:05:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:05:14 user nova-compute[76442]: INFO nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 14 21:05:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:05:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-d5064015-5242-4f99-8821-b035b1ad1db9 req-8997dd2d-72ea-4e00-838c-19d7ca9829c0 service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received event network-vif-plugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:05:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d5064015-5242-4f99-8821-b035b1ad1db9 req-8997dd2d-72ea-4e00-838c-19d7ca9829c0 service nova] Acquiring lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:05:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d5064015-5242-4f99-8821-b035b1ad1db9 req-8997dd2d-72ea-4e00-838c-19d7ca9829c0 service nova] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:05:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d5064015-5242-4f99-8821-b035b1ad1db9 req-8997dd2d-72ea-4e00-838c-19d7ca9829c0 service nova] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:05:14 user nova-compute[76442]: DEBUG nova.compute.manager [req-d5064015-5242-4f99-8821-b035b1ad1db9 req-8997dd2d-72ea-4e00-838c-19d7ca9829c0 service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] No waiting events found dispatching network-vif-plugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:05:14 user nova-compute[76442]: WARNING nova.compute.manager [req-d5064015-5242-4f99-8821-b035b1ad1db9 req-8997dd2d-72ea-4e00-838c-19d7ca9829c0 service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received unexpected event network-vif-plugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 for instance with vm_state building and task_state spawning.
Nov 14 21:05:14 user nova-compute[76442]: INFO nova.compute.manager [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Took 10.77 seconds to build instance.
Nov 14 21:05:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-248a7bd6-6718-4baa-a80c-4d000f77d781 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "78954580-ac3e-436f-894f-10c6c1f6994d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.862s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:05:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:18 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:05:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:05:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:05:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:05:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:05:26 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:05:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:05:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:26 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:05:27 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:05:27 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:05:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=25.141082763671875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 78954580-ac3e-436f-894f-10c6c1f6994d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:05:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:05:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:05:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:05:29 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:05:30 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating instance_info_cache with network_info: [{"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:05:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-63f99719-dcf0-4296-8c1b-8cbed44869c6" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:05:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:05:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:05:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:05:32 user nova-compute[76442]: INFO nova.compute.manager [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Detaching volume ce8e3d02-199b-493c-8ec0-efb3a5606177
Nov 14 21:05:32 user nova-compute[76442]: INFO nova.virt.block_device [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Attempting to driver detach volume ce8e3d02-199b-493c-8ec0-efb3a5606177 from mountpoint /dev/vdc
Nov 14 21:05:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Attempting to detach device vdc from instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 21:05:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:05:32 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:05:32 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 21:05:32 user nova-compute[76442]:   <target dev="vdc" bus="virtio"/>
Nov 14 21:05:32 user nova-compute[76442]:   <serial>ce8e3d02-199b-493c-8ec0-efb3a5606177</serial>
Nov 14 21:05:32 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 21:05:32 user nova-compute[76442]: </disk>
Nov 14 21:05:32 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:05:32 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully detached device vdc from instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 from the persistent domain config.
Nov 14 21:05:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 21:05:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:05:32 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:05:32 user nova-compute[76442]:   <source dev="/dev/sdd"/>
Nov 14 21:05:32 user nova-compute[76442]:   <target dev="vdc" bus="virtio"/>
Nov 14 21:05:32 user nova-compute[76442]:   <serial>ce8e3d02-199b-493c-8ec0-efb3a5606177</serial>
Nov 14 21:05:32 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 21:05:32 user nova-compute[76442]: </disk>
Nov 14 21:05:32 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:05:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 21:05:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:05:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:05:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 is timed out.
Nov 14 21:05:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully detached device vdc from instance 63f99719-dcf0-4296-8c1b-8cbed44869c6 from the live domain config.
Nov 14 21:05:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUFxDpAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:05:52 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c8df10-dc3c-4ad3-b150-40534145b489]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:05:52 user nova-compute[76442]: No targets found.
Nov 14 21:05:52 user nova-compute[76442]: iSNS:
Nov 14 21:05:52 user nova-compute[76442]: No targets found.
Nov 14 21:05:52 user nova-compute[76442]: STATIC:
Nov 14 21:05:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44
Nov 14 21:05:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:05:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:05:52 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177
Nov 14 21:05:52 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:05:52 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:05:52 user nova-compute[76442]: FIRMWARE:
Nov 14 21:05:52 user nova-compute[76442]: No targets found.
Nov 14 21:05:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:05:52 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:05:52 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4e857-faaf-4bf1-a3fa-a0c1f25bb53f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4542bace-54f0-4daa-ab01-64c5a40beb79]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:05:52 user nova-compute[76442]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:05:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 (non-flash)
Nov 14 21:05:52 user nova-compute[76442]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:05:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e8793490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177'): ({'sdd'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Removing single pathed devices sdd {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a1a458-7675-4a6f-acc7-6d8dbc9abdf6]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb562a3-3de1-49ea-bf62-e0abbfde4b9b]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Flushing IO for device /dev/sdd {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d846bf4-417f-4404-86d8-51cddfc3b718]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2addd6f2-b748-4a6d-a7f9-3e5124eeae3c]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] SCSI volumes sdd have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e9110b-0a26-44d6-a827-771c9191b89c]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4beb228d-ac7d-4960-b004-8ec0577f4f61]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177, portal: 172.16.0.220,3260]
Nov 14 21:05:52 user nova-compute[76442]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177, portal: 172.16.0.220,3260] successful.
Nov 14 21:05:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce8e3d02-199b-493c-8ec0-efb3a5606177 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23d3a2c-1dd1-4a42-b684-fd380dc03377]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] <== disconnect_volume: return (302ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:05:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:05:53 user nova-compute[76442]: DEBUG nova.objects.instance [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'flavor' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:05:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-424bbfd0-40f0-4ec2-bed6-3396f3109894 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.545s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:05:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:06:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:06:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:06:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:06:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:22 user nova-compute[76442]: INFO nova.compute.manager [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Terminating instance
Nov 14 21:06:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Instance destroyed successfully.
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.objects.instance [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'resources' on Instance uuid 63f99719-dcf0-4296-8c1b-8cbed44869c6 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T20:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1421805467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1421805467',id=45,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcINiknkA7aCqomMgBZc2X1SnwUEE99VoWXMBQMiNMXVJy/UWIx41ju+rCyyf0a0z11bGtRnTS4EXA/kDRJlG9gRDVlMSgDaZZJ88A96cRYhM1XXtIAGlTgQdZseusryg==',key_name='tempest-keypair-2143665200',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:03:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-5vkspjq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:03:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=63f99719-dcf0-4296-8c1b-8cbed44869c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "address": "fa:16:3e:f5:2d:50", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a0cd1a-03", "ovs_interfaceid": "53a0cd1a-030f-45b9-8f40-0e15dd5b214d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG os_vif [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53a0cd1a-03, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66bb5a00-2d4e-4575-9793-4d1a58fa5630) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:06:23 user nova-compute[76442]: INFO os_vif [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:2d:50,bridge_name='br-int',has_traffic_filtering=True,id=53a0cd1a-030f-45b9-8f40-0e15dd5b214d,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a0cd1a-03')
Nov 14 21:06:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Deleting instance files /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6_del
Nov 14 21:06:23 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Deletion of /opt/stack/data/nova/instances/63f99719-dcf0-4296-8c1b-8cbed44869c6_del complete
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e43fbe6-3f3b-40c9-a97a-489d15ccf59d req-1f8e781d-c597-4d2e-9967-abe5df585917 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-unplugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e43fbe6-3f3b-40c9-a97a-489d15ccf59d req-1f8e781d-c597-4d2e-9967-abe5df585917 service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e43fbe6-3f3b-40c9-a97a-489d15ccf59d req-1f8e781d-c597-4d2e-9967-abe5df585917 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-4e43fbe6-3f3b-40c9-a97a-489d15ccf59d req-1f8e781d-c597-4d2e-9967-abe5df585917 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e43fbe6-3f3b-40c9-a97a-489d15ccf59d req-1f8e781d-c597-4d2e-9967-abe5df585917 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-unplugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.compute.manager [req-4e43fbe6-3f3b-40c9-a97a-489d15ccf59d req-1f8e781d-c597-4d2e-9967-abe5df585917 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-unplugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:06:23 user nova-compute[76442]: INFO nova.compute.manager [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 21:06:23 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:06:24 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Took 1.00 seconds to deallocate network for instance.
Nov 14 21:06:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:06:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:24 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Deleted allocations for instance 63f99719-dcf0-4296-8c1b-8cbed44869c6
Nov 14 21:06:24 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-80f0819a-aa34-4841-9d17-4341694694fc tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.459s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-5b0b1d43-662f-4df3-bf43-fe7616b0a91f req-4f6db222-59f8-4c8b-b029-e946053dfbc7 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:06:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5b0b1d43-662f-4df3-bf43-fe7616b0a91f req-4f6db222-59f8-4c8b-b029-e946053dfbc7 service nova] Acquiring lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5b0b1d43-662f-4df3-bf43-fe7616b0a91f req-4f6db222-59f8-4c8b-b029-e946053dfbc7 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5b0b1d43-662f-4df3-bf43-fe7616b0a91f req-4f6db222-59f8-4c8b-b029-e946053dfbc7 service nova] Lock "63f99719-dcf0-4296-8c1b-8cbed44869c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-5b0b1d43-662f-4df3-bf43-fe7616b0a91f req-4f6db222-59f8-4c8b-b029-e946053dfbc7 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] No waiting events found dispatching network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:06:25 user nova-compute[76442]: WARNING nova.compute.manager [req-5b0b1d43-662f-4df3-bf43-fe7616b0a91f req-4f6db222-59f8-4c8b-b029-e946053dfbc7 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received unexpected event network-vif-plugged-53a0cd1a-030f-45b9-8f40-0e15dd5b214d for instance with vm_state deleted and task_state None.
Nov 14 21:06:25 user nova-compute[76442]: DEBUG nova.compute.manager [req-5b0b1d43-662f-4df3-bf43-fe7616b0a91f req-4f6db222-59f8-4c8b-b029-e946053dfbc7 service nova] [instance: 63f99719-dcf0-4296-8c1b-8cbed44869c6] Received event network-vif-deleted-53a0cd1a-030f-45b9-8f40-0e15dd5b214d {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:06:27 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:06:27 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:06:27 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:06:27 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:06:27 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.159748077392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:06:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 78954580-ac3e-436f-894f-10c6c1f6994d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:06:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:06:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:06:28 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:06:28 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:06:28 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:06:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 78954580-ac3e-436f-894f-10c6c1f6994d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Updating instance_info_cache with network_info: [{"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:49 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:06:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 21:06:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-d1daffdb-bfa4-44d6-b0ae-9240abc31a23 req-f701b69c-8521-4312-85eb-c88e3762a0cd service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received event network-changed-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:06:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-d1daffdb-bfa4-44d6-b0ae-9240abc31a23 req-f701b69c-8521-4312-85eb-c88e3762a0cd service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Refreshing instance network info cache due to event network-changed-88c8fc6a-5761-477c-8ab2-9dd60a534f19. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:06:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1daffdb-bfa4-44d6-b0ae-9240abc31a23 req-f701b69c-8521-4312-85eb-c88e3762a0cd service nova] Acquiring lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:06:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1daffdb-bfa4-44d6-b0ae-9240abc31a23 req-f701b69c-8521-4312-85eb-c88e3762a0cd service nova] Acquired lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:06:55 user nova-compute[76442]: DEBUG nova.network.neutron [req-d1daffdb-bfa4-44d6-b0ae-9240abc31a23 req-f701b69c-8521-4312-85eb-c88e3762a0cd service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Refreshing network info cache for port 88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "78954580-ac3e-436f-894f-10c6c1f6994d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "78954580-ac3e-436f-894f-10c6c1f6994d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-d1daffdb-bfa4-44d6-b0ae-9240abc31a23 req-f701b69c-8521-4312-85eb-c88e3762a0cd service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Updated VIF entry in instance network info cache for port 88c8fc6a-5761-477c-8ab2-9dd60a534f19. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-d1daffdb-bfa4-44d6-b0ae-9240abc31a23 req-f701b69c-8521-4312-85eb-c88e3762a0cd service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Updating instance_info_cache with network_info: [{"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:06:56 user nova-compute[76442]: INFO nova.compute.manager [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Terminating instance
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d1daffdb-bfa4-44d6-b0ae-9240abc31a23 req-f701b69c-8521-4312-85eb-c88e3762a0cd service nova] Releasing lock "refresh_cache-78954580-ac3e-436f-894f-10c6c1f6994d" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-f5af3f53-b76b-402a-ae50-76f6b1c8d0fb req-2313883d-8878-4300-bf30-e34ab3f68d16 service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received event network-vif-unplugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f5af3f53-b76b-402a-ae50-76f6b1c8d0fb req-2313883d-8878-4300-bf30-e34ab3f68d16 service nova] Acquiring lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f5af3f53-b76b-402a-ae50-76f6b1c8d0fb req-2313883d-8878-4300-bf30-e34ab3f68d16 service nova] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f5af3f53-b76b-402a-ae50-76f6b1c8d0fb req-2313883d-8878-4300-bf30-e34ab3f68d16 service nova] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-f5af3f53-b76b-402a-ae50-76f6b1c8d0fb req-2313883d-8878-4300-bf30-e34ab3f68d16 service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] No waiting events found dispatching network-vif-unplugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.compute.manager [req-f5af3f53-b76b-402a-ae50-76f6b1c8d0fb req-2313883d-8878-4300-bf30-e34ab3f68d16 service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received event network-vif-unplugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:06:56 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Instance destroyed successfully.
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.objects.instance [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'resources' on Instance uuid 78954580-ac3e-436f-894f-10c6c1f6994d {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-132875762',display_name='tempest-TestVolumeBootPattern-server-132875762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-132875762',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMqtgJcFo+NzjA+7zu6HEvMzvBBa7Tnf+vJ5z+1XXrfQbhOVQpKiDoQUweMd2Q4UWCll8fgk22nliL1Wnofn524UJjbOUqMcyJZsIShi3LXF6K6AvSqhcjKFsOqpiDXyA==',key_name='tempest-TestVolumeBootPattern-280068245',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:05:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-bi23rq9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:05:14Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=78954580-ac3e-436f-894f-10c6c1f6994d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "address": "fa:16:3e:1d:6f:c5", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8fc6a-57", "ovs_interfaceid": "88c8fc6a-5761-477c-8ab2-9dd60a534f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:6f:c5,bridge_name='br-int',has_traffic_filtering=True,id=88c8fc6a-5761-477c-8ab2-9dd60a534f19,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8fc6a-57') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:06:56 user nova-compute[76442]: DEBUG os_vif [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:6f:c5,bridge_name='br-int',has_traffic_filtering=True,id=88c8fc6a-5761-477c-8ab2-9dd60a534f19,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8fc6a-57') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88c8fc6a-57, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e071f17-d3b7-4b89-86bd-5ddecaf9352c) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:06:57 user nova-compute[76442]: INFO os_vif [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:6f:c5,bridge_name='br-int',has_traffic_filtering=True,id=88c8fc6a-5761-477c-8ab2-9dd60a534f19,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8fc6a-57')
Nov 14 21:06:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoYMbnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:06:57 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d24ea2-553f-47a0-8bf7-d0605fae3a77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:06:57 user nova-compute[76442]: No targets found.
Nov 14 21:06:57 user nova-compute[76442]: iSNS:
Nov 14 21:06:57 user nova-compute[76442]: No targets found.
Nov 14 21:06:57 user nova-compute[76442]: STATIC:
Nov 14 21:06:57 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44
Nov 14 21:06:57 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:06:57 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:06:57 user nova-compute[76442]: FIRMWARE:
Nov 14 21:06:57 user nova-compute[76442]: No targets found.
Nov 14 21:06:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:06:57 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:06:57 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c66e1-61ea-46f3-bb11-00bdeabec858]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e97015c-c44e-433c-a97a-decbe18710b9]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:06:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:06:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e84b39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[30997954-f92c-4bc8-8e86-e974043f56ba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b5e18-d1d5-4fc5-9e66-62ccec5bb009]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a3ed8e-40aa-45fd-b6b0-7f7c8d32269e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[384f9a00-231f-4a3e-bad6-dae4111c0d0b]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8f743d3a-eca21e46da44bd53', '/dev/disk/by-id/scsi-26563613231653436', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8f743d3a') {{(pid=87657) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[73731184-dd95-46d5-bba3-b40f71540a9e]: (4, None) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb49eb6-58c8-421e-9d0f-92e8e7583fd7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[738c2291-a359-4c8b-a795-5a8595ae2f16]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260]
Nov 14 21:06:57 user nova-compute[76442]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260] successful.
Nov 14 21:06:57 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc62a2e-c876-415b-9913-293c9534ee81]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== disconnect_volume: return (281ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:06:57 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Deleting instance files /opt/stack/data/nova/instances/78954580-ac3e-436f-894f-10c6c1f6994d_del
Nov 14 21:06:57 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Deletion of /opt/stack/data/nova/instances/78954580-ac3e-436f-894f-10c6c1f6994d_del complete
Nov 14 21:06:57 user nova-compute[76442]: INFO nova.compute.manager [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 14 21:06:57 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:06:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:06:58 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:06:58 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Took 0.79 seconds to deallocate network for instance.
Nov 14 21:06:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-c54e0ce6-038c-4a12-bb39-b4fefc3314e9 req-673bad80-cb09-4cd8-a9ae-e3ec7b3ed9cd service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received event network-vif-plugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:06:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c54e0ce6-038c-4a12-bb39-b4fefc3314e9 req-673bad80-cb09-4cd8-a9ae-e3ec7b3ed9cd service nova] Acquiring lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c54e0ce6-038c-4a12-bb39-b4fefc3314e9 req-673bad80-cb09-4cd8-a9ae-e3ec7b3ed9cd service nova] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c54e0ce6-038c-4a12-bb39-b4fefc3314e9 req-673bad80-cb09-4cd8-a9ae-e3ec7b3ed9cd service nova] Lock "78954580-ac3e-436f-894f-10c6c1f6994d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-c54e0ce6-038c-4a12-bb39-b4fefc3314e9 req-673bad80-cb09-4cd8-a9ae-e3ec7b3ed9cd service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] No waiting events found dispatching network-vif-plugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:06:58 user nova-compute[76442]: WARNING nova.compute.manager [req-c54e0ce6-038c-4a12-bb39-b4fefc3314e9 req-673bad80-cb09-4cd8-a9ae-e3ec7b3ed9cd service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received unexpected event network-vif-plugged-88c8fc6a-5761-477c-8ab2-9dd60a534f19 for instance with vm_state active and task_state deleting.
Nov 14 21:06:58 user nova-compute[76442]: DEBUG nova.compute.manager [req-c54e0ce6-038c-4a12-bb39-b4fefc3314e9 req-673bad80-cb09-4cd8-a9ae-e3ec7b3ed9cd service nova] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Received event network-vif-deleted-88c8fc6a-5761-477c-8ab2-9dd60a534f19 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:06:58 user nova-compute[76442]: INFO nova.compute.manager [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 78954580-ac3e-436f-894f-10c6c1f6994d] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 21:06:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:06:58 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:06:58 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:06:59 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:06:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:06:59 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Deleted allocations for instance 78954580-ac3e-436f-894f-10c6c1f6994d
Nov 14 21:06:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-28bb6c40-17e7-448c-80ab-a4f730924ab5 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "78954580-ac3e-436f-894f-10c6c1f6994d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:07:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:07:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:07:16 user nova-compute[76442]: INFO nova.compute.claims [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Claim successful on node user
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.network.neutron [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 21:07:16 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.policy [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb9d2e0b8d7b4bdf94872e2186dfad31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04176df08b194d959611acf480360493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:07:16 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Creating image(s)
Nov 14 21:07:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.179s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk 1073741824" returned: 0 in 0.046s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG nova.network.neutron [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Successfully created port: 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.166s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Cannot resize image /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Ensure instance console log exists: /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Successfully updated port: 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-520516d9-1c3b-475d-a5b6-0d04103079b3 req-64527dea-c10d-45bb-af23-117554cb2453 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-changed-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-520516d9-1c3b-475d-a5b6-0d04103079b3 req-64527dea-c10d-45bb-af23-117554cb2453 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Refreshing instance network info cache due to event network-changed-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-520516d9-1c3b-475d-a5b6-0d04103079b3 req-64527dea-c10d-45bb-af23-117554cb2453 service nova] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.neutron [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance network_info: |[{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-520516d9-1c3b-475d-a5b6-0d04103079b3 req-64527dea-c10d-45bb-af23-117554cb2453 service nova] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-520516d9-1c3b-475d-a5b6-0d04103079b3 req-64527dea-c10d-45bb-af23-117554cb2453 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Refreshing network info cache for port 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Start _get_guest_xml network_info=[{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:07:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:07:18 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1288273930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1288273930',id=48,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+j4kvpalFxvR4qeYGA0ZBZD+ERFLswDkCwPZwJ5LzhDlvETYXxqUo94IqtD4jG/yC872nZzlEV/mk8Zaxa7a4MrCUSa8ZvOq4FdXTe8Vip50N9sWsiL4g7BJAimizMQA==',key_name='tempest-keypair-1958698388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-v27gb2ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=68cabd44-d0ff-49db-89e9-e6282a25a6fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.objects.instance [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'pci_devices' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:07:18 user nova-compute[76442]:   <uuid>68cabd44-d0ff-49db-89e9-e6282a25a6fb</uuid>
Nov 14 21:07:18 user nova-compute[76442]:   <name>instance-00000030</name>
Nov 14 21:07:18 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:07:18 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:07:18 user nova-compute[76442]:   <metadata>
Nov 14 21:07:18 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:07:18 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:07:18 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1288273930</nova:name>
Nov 14 21:07:18 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:07:18</nova:creationTime>
Nov 14 21:07:18 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:07:18 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:07:18 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:07:18 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:07:18 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:07:18 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:07:18 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:07:18 user nova-compute[76442]:       <nova:owner>
Nov 14 21:07:18 user nova-compute[76442]:         <nova:user uuid="eb9d2e0b8d7b4bdf94872e2186dfad31">tempest-AttachVolumeShelveTestJSON-1848978120-project-member</nova:user>
Nov 14 21:07:18 user nova-compute[76442]:         <nova:project uuid="04176df08b194d959611acf480360493">tempest-AttachVolumeShelveTestJSON-1848978120</nova:project>
Nov 14 21:07:18 user nova-compute[76442]:       </nova:owner>
Nov 14 21:07:18 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 21:07:18 user nova-compute[76442]:       <nova:ports>
Nov 14 21:07:18 user nova-compute[76442]:         <nova:port uuid="00ab2ff2-d8cd-43ea-bde7-286df17ad6d6">
Nov 14 21:07:18 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 21:07:18 user nova-compute[76442]:         </nova:port>
Nov 14 21:07:18 user nova-compute[76442]:       </nova:ports>
Nov 14 21:07:18 user nova-compute[76442]:     </nova:instance>
Nov 14 21:07:18 user nova-compute[76442]:   </metadata>
Nov 14 21:07:18 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:07:18 user nova-compute[76442]:     <system>
Nov 14 21:07:18 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:07:18 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:07:18 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:07:18 user nova-compute[76442]:       <entry name="serial">68cabd44-d0ff-49db-89e9-e6282a25a6fb</entry>
Nov 14 21:07:18 user nova-compute[76442]:       <entry name="uuid">68cabd44-d0ff-49db-89e9-e6282a25a6fb</entry>
Nov 14 21:07:18 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:07:18 user nova-compute[76442]:     </system>
Nov 14 21:07:18 user nova-compute[76442]:   </sysinfo>
Nov 14 21:07:18 user nova-compute[76442]:   <os>
Nov 14 21:07:18 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:07:18 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:07:18 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:07:18 user nova-compute[76442]:   </os>
Nov 14 21:07:18 user nova-compute[76442]:   <features>
Nov 14 21:07:18 user nova-compute[76442]:     <acpi/>
Nov 14 21:07:18 user nova-compute[76442]:     <apic/>
Nov 14 21:07:18 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:07:18 user nova-compute[76442]:   </features>
Nov 14 21:07:18 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:07:18 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:07:18 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:07:18 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:07:18 user nova-compute[76442]:   </clock>
Nov 14 21:07:18 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:07:18 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:07:18 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:07:18 user nova-compute[76442]:   </cpu>
Nov 14 21:07:18 user nova-compute[76442]:   <devices>
Nov 14 21:07:18 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 21:07:18 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 21:07:18 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk"/>
Nov 14 21:07:18 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:07:18 user nova-compute[76442]:     </disk>
Nov 14 21:07:18 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:07:18 user nova-compute[76442]:       <mac address="fa:16:3e:43:ed:6e"/>
Nov 14 21:07:18 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:07:18 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:07:18 user nova-compute[76442]:       <target dev="tap00ab2ff2-d8"/>
Nov 14 21:07:18 user nova-compute[76442]:     </interface>
Nov 14 21:07:18 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:07:18 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/console.log" append="off"/>
Nov 14 21:07:18 user nova-compute[76442]:     </serial>
Nov 14 21:07:18 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:07:18 user nova-compute[76442]:     <video>
Nov 14 21:07:18 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:07:18 user nova-compute[76442]:     </video>
Nov 14 21:07:18 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:07:18 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:07:18 user nova-compute[76442]:     </rng>
Nov 14 21:07:18 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:07:18 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:07:18 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:07:18 user nova-compute[76442]:     </memballoon>
Nov 14 21:07:18 user nova-compute[76442]:   </devices>
Nov 14 21:07:18 user nova-compute[76442]: </domain>
Nov 14 21:07:18 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1288273930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1288273930',id=48,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+j4kvpalFxvR4qeYGA0ZBZD+ERFLswDkCwPZwJ5LzhDlvETYXxqUo94IqtD4jG/yC872nZzlEV/mk8Zaxa7a4MrCUSa8ZvOq4FdXTe8Vip50N9sWsiL4g7BJAimizMQA==',key_name='tempest-keypair-1958698388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-v27gb2ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=68cabd44-d0ff-49db-89e9-e6282a25a6fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG os_vif [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94526910-dc24-5f2d-9125-982a6f1aac7d', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00ab2ff2-d8, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00ab2ff2-d8, col_values=(('qos', UUID('2ed99242-251c-4b26-b8f8-011441da978b')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00ab2ff2-d8, col_values=(('external_ids', {'iface-id': '00ab2ff2-d8cd-43ea-bde7-286df17ad6d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:ed:6e', 'vm-uuid': '68cabd44-d0ff-49db-89e9-e6282a25a6fb'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:18 user nova-compute[76442]: INFO os_vif [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8')
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] No VIF found with MAC fa:16:3e:43:ed:6e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-520516d9-1c3b-475d-a5b6-0d04103079b3 req-64527dea-c10d-45bb-af23-117554cb2453 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updated VIF entry in instance network info cache for port 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG nova.network.neutron [req-520516d9-1c3b-475d-a5b6-0d04103079b3 req-64527dea-c10d-45bb-af23-117554cb2453 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:07:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-520516d9-1c3b-475d-a5b6-0d04103079b3 req-64527dea-c10d-45bb-af23-117554cb2453 service nova] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:07:19 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-e5e8007e-44b6-4430-92f1-7e58d3556b40 req-6091ae6a-704a-4bc4-819b-0827ef464a30 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:07:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e5e8007e-44b6-4430-92f1-7e58d3556b40 req-6091ae6a-704a-4bc4-819b-0827ef464a30 service nova] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e5e8007e-44b6-4430-92f1-7e58d3556b40 req-6091ae6a-704a-4bc4-819b-0827ef464a30 service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-e5e8007e-44b6-4430-92f1-7e58d3556b40 req-6091ae6a-704a-4bc4-819b-0827ef464a30 service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-e5e8007e-44b6-4430-92f1-7e58d3556b40 req-6091ae6a-704a-4bc4-819b-0827ef464a30 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] No waiting events found dispatching network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:07:20 user nova-compute[76442]: WARNING nova.compute.manager [req-e5e8007e-44b6-4430-92f1-7e58d3556b40 req-6091ae6a-704a-4bc4-819b-0827ef464a30 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received unexpected event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 for instance with vm_state building and task_state spawning.
Nov 14 21:07:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:21 user nova-compute[76442]: DEBUG nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:07:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:07:21 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance spawned successfully.
Nov 14 21:07:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 21:07:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:22 user nova-compute[76442]: INFO nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 14 21:07:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:07:22 user nova-compute[76442]: INFO nova.compute.manager [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Took 5.60 seconds to build instance.
Nov 14 21:07:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-db6fa4ab-524b-47b7-aa9d-08655e4fbdf7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.721s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-5f0809c0-a611-40d9-84ed-304ca3fcb247 req-61705179-6e25-4966-ae6d-24acab740d73 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:07:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5f0809c0-a611-40d9-84ed-304ca3fcb247 req-61705179-6e25-4966-ae6d-24acab740d73 service nova] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5f0809c0-a611-40d9-84ed-304ca3fcb247 req-61705179-6e25-4966-ae6d-24acab740d73 service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5f0809c0-a611-40d9-84ed-304ca3fcb247 req-61705179-6e25-4966-ae6d-24acab740d73 service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:22 user nova-compute[76442]: DEBUG nova.compute.manager [req-5f0809c0-a611-40d9-84ed-304ca3fcb247 req-61705179-6e25-4966-ae6d-24acab740d73 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] No waiting events found dispatching network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:07:22 user nova-compute[76442]: WARNING nova.compute.manager [req-5f0809c0-a611-40d9-84ed-304ca3fcb247 req-61705179-6e25-4966-ae6d-24acab740d73 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received unexpected event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 for instance with vm_state active and task_state None.
Nov 14 21:07:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:23 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:07:24 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:27 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:29 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:07:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:30 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:07:30 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:07:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.157543182373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:07:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 68cabd44-d0ff-49db-89e9-e6282a25a6fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:07:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:07:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:07:30 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:07:30 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:07:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:07:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:07:32 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:07:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:07:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "06086205-4963-4336-8652-e93842bc8a3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "06086205-4963-4336-8652-e93842bc8a3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 21:07:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:47 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:07:47 user nova-compute[76442]: INFO nova.compute.claims [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Claim successful on node user
Nov 14 21:07:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:47 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:07:47 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 21:07:48 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 21:07:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG nova.policy [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f2d3fa02ad4ccbb286f49b8e59563d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaf0b599d7c4224be5cab0f23b95157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 21:07:48 user nova-compute[76442]: INFO nova.virt.block_device [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Booting with volume 22c817b9-dda6-48ed-855a-5bfe80431d44 at /dev/vda
Nov 14 21:07:48 user nova-compute[76442]: DEBUG os_brick.utils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[36448c36-6911-4c57-a0c4-f1e001dc20b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[91028531-8857-49fb-8b56-8100a0423152]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af78957-a332-47c7-b7cd-279d8647085c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a012d27-97e6-4259-bef6-0faa3ee46e46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:07:48 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:07:48 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bbb24d-1db8-44a3-aaf9-ff2ea12c8bc1]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG os_brick.utils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updating existing volume attachment record: 675cc822-8b9e-4b8e-bea5-7f9f71b14bd7 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Successfully created port: 33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Successfully updated port: 33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquired lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-8307c1bd-93b9-49ae-9a9d-4fbfe439377c req-ae24c421-2466-460a-9cd5-8a3847ffd4f8 service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received event network-changed-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG nova.compute.manager [req-8307c1bd-93b9-49ae-9a9d-4fbfe439377c req-ae24c421-2466-460a-9cd5-8a3847ffd4f8 service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Refreshing instance network info cache due to event network-changed-33f7be7b-505a-4c3c-a763-68553d8af784. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8307c1bd-93b9-49ae-9a9d-4fbfe439377c req-ae24c421-2466-460a-9cd5-8a3847ffd4f8 service nova] Acquiring lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updating instance_info_cache with network_info: [{"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Releasing lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Instance network_info: |[{"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8307c1bd-93b9-49ae-9a9d-4fbfe439377c req-ae24c421-2466-460a-9cd5-8a3847ffd4f8 service nova] Acquired lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:07:49 user nova-compute[76442]: DEBUG nova.network.neutron [req-8307c1bd-93b9-49ae-9a9d-4fbfe439377c req-ae24c421-2466-460a-9cd5-8a3847ffd4f8 service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Refreshing network info cache for port 33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:07:50 user nova-compute[76442]: DEBUG nova.network.neutron [req-8307c1bd-93b9-49ae-9a9d-4fbfe439377c req-ae24c421-2466-460a-9cd5-8a3847ffd4f8 service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updated VIF entry in instance network info cache for port 33f7be7b-505a-4c3c-a763-68553d8af784. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:07:50 user nova-compute[76442]: DEBUG nova.network.neutron [req-8307c1bd-93b9-49ae-9a9d-4fbfe439377c req-ae24c421-2466-460a-9cd5-8a3847ffd4f8 service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updating instance_info_cache with network_info: [{"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:07:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8307c1bd-93b9-49ae-9a9d-4fbfe439377c req-ae24c421-2466-460a-9cd5-8a3847ffd4f8 service nova] Releasing lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:07:52 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Creating image(s)
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Ensure instance console log exists: /opt/stack/data/nova/instances/06086205-4963-4336-8652-e93842bc8a3b/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Start _get_guest_xml network_info=[{"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoYMbnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06086205-4963-4336-8652-e93842bc8a3b', 'attached_at': '', 'detached_at': '', 'volume_id': '22c817b9-dda6-48ed-855a-5bfe80431d44', 'serial': '22c817b9-dda6-48ed-855a-5bfe80431d44'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '675cc822-8b9e-4b8e-bea5-7f9f71b14bd7', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:07:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:07:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoYMbnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:07:52 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:07:52 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:07:52 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b169716-5006-4656-af7c-d3682a21a9ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:07:52 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b0c687-bf86-418a-b89c-25bb38021f99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44] added
Nov 14 21:07:52 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2823f0-7de4-424f-9e63-b27f251a2036]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3466095-3eb9-4b0e-bba4-c474ef483ec9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAoYMbnr {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAoYMbnr" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[18758f9f-24b2-40b8-a531-64eb280776fd]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FAoYMbnr'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c30b3-35f3-4fc6-b5e4-93ecea5f75e3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:07:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff62f7-43a2-4c23-9e81-750921efd298]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:07:53 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:07:53 user nova-compute[76442]:  {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:07:53 user nova-compute[76442]: WARNING os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 21:07:53 user nova-compute[76442]: 
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[60490b5d-ecee-446b-a39a-930e1fb178a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260]
Nov 14 21:07:53 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260] successful.
Nov 14 21:07:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[96881849-7d08-46b8-88cc-f4a4ee1246c7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a0ec84-1a1a-4058-9ef7-fb5331fa3c85]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:07:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:07:53 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7afbe7-fa03-49ff-89b2-f4c49b33a52e]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoYMbnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:07:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '26563613231653436', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563613231653436', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1802437464',display_name='tempest-TestVolumeBootPattern-server-1802437464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1802437464',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMqtgJcFo+NzjA+7zu6HEvMzvBBa7Tnf+vJ5z+1XXrfQbhOVQpKiDoQUweMd2Q4UWCll8fgk22nliL1Wnofn524UJjbOUqMcyJZsIShi3LXF6K6AvSqhcjKFsOqpiDXyA==',key_name='tempest-TestVolumeBootPattern-280068245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-yg59g3j7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:07:48Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=06086205-4963-4336-8652-e93842bc8a3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:bb:26,bridge_name='br-int',has_traffic_filtering=True,id=33f7be7b-505a-4c3c-a763-68553d8af784,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f7be7b-50') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.objects.instance [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'pci_devices' on Instance uuid 06086205-4963-4336-8652-e93842bc8a3b {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:07:54 user nova-compute[76442]:   <uuid>06086205-4963-4336-8652-e93842bc8a3b</uuid>
Nov 14 21:07:54 user nova-compute[76442]:   <name>instance-00000031</name>
Nov 14 21:07:54 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:07:54 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:07:54 user nova-compute[76442]:   <metadata>
Nov 14 21:07:54 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:07:54 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:07:54 user nova-compute[76442]:       <nova:name>tempest-TestVolumeBootPattern-server-1802437464</nova:name>
Nov 14 21:07:54 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:07:52</nova:creationTime>
Nov 14 21:07:54 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:07:54 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:07:54 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:07:54 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:07:54 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:07:54 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:07:54 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:07:54 user nova-compute[76442]:       <nova:owner>
Nov 14 21:07:54 user nova-compute[76442]:         <nova:user uuid="85f2d3fa02ad4ccbb286f49b8e59563d">tempest-TestVolumeBootPattern-792728264-project-member</nova:user>
Nov 14 21:07:54 user nova-compute[76442]:         <nova:project uuid="bcaf0b599d7c4224be5cab0f23b95157">tempest-TestVolumeBootPattern-792728264</nova:project>
Nov 14 21:07:54 user nova-compute[76442]:       </nova:owner>
Nov 14 21:07:54 user nova-compute[76442]:       <nova:ports>
Nov 14 21:07:54 user nova-compute[76442]:         <nova:port uuid="33f7be7b-505a-4c3c-a763-68553d8af784">
Nov 14 21:07:54 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 21:07:54 user nova-compute[76442]:         </nova:port>
Nov 14 21:07:54 user nova-compute[76442]:       </nova:ports>
Nov 14 21:07:54 user nova-compute[76442]:     </nova:instance>
Nov 14 21:07:54 user nova-compute[76442]:   </metadata>
Nov 14 21:07:54 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:07:54 user nova-compute[76442]:     <system>
Nov 14 21:07:54 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:07:54 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:07:54 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:07:54 user nova-compute[76442]:       <entry name="serial">06086205-4963-4336-8652-e93842bc8a3b</entry>
Nov 14 21:07:54 user nova-compute[76442]:       <entry name="uuid">06086205-4963-4336-8652-e93842bc8a3b</entry>
Nov 14 21:07:54 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:07:54 user nova-compute[76442]:     </system>
Nov 14 21:07:54 user nova-compute[76442]:   </sysinfo>
Nov 14 21:07:54 user nova-compute[76442]:   <os>
Nov 14 21:07:54 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:07:54 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:07:54 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:07:54 user nova-compute[76442]:   </os>
Nov 14 21:07:54 user nova-compute[76442]:   <features>
Nov 14 21:07:54 user nova-compute[76442]:     <acpi/>
Nov 14 21:07:54 user nova-compute[76442]:     <apic/>
Nov 14 21:07:54 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:07:54 user nova-compute[76442]:   </features>
Nov 14 21:07:54 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:07:54 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:07:54 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:07:54 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:07:54 user nova-compute[76442]:   </clock>
Nov 14 21:07:54 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:07:54 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:07:54 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:07:54 user nova-compute[76442]:   </cpu>
Nov 14 21:07:54 user nova-compute[76442]:   <devices>
Nov 14 21:07:54 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 21:07:54 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:07:54 user nova-compute[76442]:       <source dev="/dev/sdb"/>
Nov 14 21:07:54 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:07:54 user nova-compute[76442]:       <serial>22c817b9-dda6-48ed-855a-5bfe80431d44</serial>
Nov 14 21:07:54 user nova-compute[76442]:     </disk>
Nov 14 21:07:54 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:07:54 user nova-compute[76442]:       <mac address="fa:16:3e:07:bb:26"/>
Nov 14 21:07:54 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:07:54 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:07:54 user nova-compute[76442]:       <target dev="tap33f7be7b-50"/>
Nov 14 21:07:54 user nova-compute[76442]:     </interface>
Nov 14 21:07:54 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:07:54 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/06086205-4963-4336-8652-e93842bc8a3b/console.log" append="off"/>
Nov 14 21:07:54 user nova-compute[76442]:     </serial>
Nov 14 21:07:54 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:07:54 user nova-compute[76442]:     <video>
Nov 14 21:07:54 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:07:54 user nova-compute[76442]:     </video>
Nov 14 21:07:54 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:07:54 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:07:54 user nova-compute[76442]:     </rng>
Nov 14 21:07:54 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:07:54 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:07:54 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:07:54 user nova-compute[76442]:     </memballoon>
Nov 14 21:07:54 user nova-compute[76442]:   </devices>
Nov 14 21:07:54 user nova-compute[76442]: </domain>
Nov 14 21:07:54 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1802437464',display_name='tempest-TestVolumeBootPattern-server-1802437464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1802437464',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMqtgJcFo+NzjA+7zu6HEvMzvBBa7Tnf+vJ5z+1XXrfQbhOVQpKiDoQUweMd2Q4UWCll8fgk22nliL1Wnofn524UJjbOUqMcyJZsIShi3LXF6K6AvSqhcjKFsOqpiDXyA==',key_name='tempest-TestVolumeBootPattern-280068245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-yg59g3j7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:07:48Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=06086205-4963-4336-8652-e93842bc8a3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:bb:26,bridge_name='br-int',has_traffic_filtering=True,id=33f7be7b-505a-4c3c-a763-68553d8af784,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f7be7b-50') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG os_vif [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:bb:26,bridge_name='br-int',has_traffic_filtering=True,id=33f7be7b-505a-4c3c-a763-68553d8af784,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f7be7b-50') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4d27998-d98d-5d02-843f-b39a76457dc1', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33f7be7b-50, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33f7be7b-50, col_values=(('qos', UUID('1f98e6d9-66a9-49d0-927e-cdb0bf07a0c9')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33f7be7b-50, col_values=(('external_ids', {'iface-id': '33f7be7b-505a-4c3c-a763-68553d8af784', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:bb:26', 'vm-uuid': '06086205-4963-4336-8652-e93842bc8a3b'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:54 user nova-compute[76442]: INFO os_vif [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:bb:26,bridge_name='br-int',has_traffic_filtering=True,id=33f7be7b-505a-4c3c-a763-68553d8af784,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f7be7b-50')
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:07:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No VIF found with MAC fa:16:3e:07:bb:26, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:07:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-922a46e3-b18d-46e4-a88e-bc99df0a52a3 req-fa71b54b-7408-4d16-a75f-82f92ec0256b service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received event network-vif-plugged-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:07:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-922a46e3-b18d-46e4-a88e-bc99df0a52a3 req-fa71b54b-7408-4d16-a75f-82f92ec0256b service nova] Acquiring lock "06086205-4963-4336-8652-e93842bc8a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-922a46e3-b18d-46e4-a88e-bc99df0a52a3 req-fa71b54b-7408-4d16-a75f-82f92ec0256b service nova] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-922a46e3-b18d-46e4-a88e-bc99df0a52a3 req-fa71b54b-7408-4d16-a75f-82f92ec0256b service nova] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-922a46e3-b18d-46e4-a88e-bc99df0a52a3 req-fa71b54b-7408-4d16-a75f-82f92ec0256b service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] No waiting events found dispatching network-vif-plugged-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:07:55 user nova-compute[76442]: WARNING nova.compute.manager [req-922a46e3-b18d-46e4-a88e-bc99df0a52a3 req-fa71b54b-7408-4d16-a75f-82f92ec0256b service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received unexpected event network-vif-plugged-33f7be7b-505a-4c3c-a763-68553d8af784 for instance with vm_state building and task_state spawning.
Nov 14 21:07:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:07:57 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Instance spawned successfully.
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:07:57 user nova-compute[76442]: INFO nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-7559fb2d-d7f7-4ed2-ac56-8bd9a085b94b req-0566e9f8-f41d-4f16-9190-a079f76e03ab service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received event network-vif-plugged-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7559fb2d-d7f7-4ed2-ac56-8bd9a085b94b req-0566e9f8-f41d-4f16-9190-a079f76e03ab service nova] Acquiring lock "06086205-4963-4336-8652-e93842bc8a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7559fb2d-d7f7-4ed2-ac56-8bd9a085b94b req-0566e9f8-f41d-4f16-9190-a079f76e03ab service nova] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7559fb2d-d7f7-4ed2-ac56-8bd9a085b94b req-0566e9f8-f41d-4f16-9190-a079f76e03ab service nova] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-7559fb2d-d7f7-4ed2-ac56-8bd9a085b94b req-0566e9f8-f41d-4f16-9190-a079f76e03ab service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] No waiting events found dispatching network-vif-plugged-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:07:57 user nova-compute[76442]: WARNING nova.compute.manager [req-7559fb2d-d7f7-4ed2-ac56-8bd9a085b94b req-0566e9f8-f41d-4f16-9190-a079f76e03ab service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received unexpected event network-vif-plugged-33f7be7b-505a-4c3c-a763-68553d8af784 for instance with vm_state building and task_state spawning.
Nov 14 21:07:57 user nova-compute[76442]: INFO nova.compute.manager [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Took 10.09 seconds to build instance.
Nov 14 21:07:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-59d5e695-10ce-4609-a892-687a6b6ae49e tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "06086205-4963-4336-8652-e93842bc8a3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.195s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:07:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:07:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:21 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:08:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:24 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:08:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:08:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:08:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:08:27 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:08:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:08:29 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:08:30 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:08:30 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:08:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=25.128055572509766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 68cabd44-d0ff-49db-89e9-e6282a25a6fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 06086205-4963-4336-8652-e93842bc8a3b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:08:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:08:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:08:33 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:08:33 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:08:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:08:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:08:33 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:08:33 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:08:34 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:08:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:08:34 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:08:34 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:08:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:08:36 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:08:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:08:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:08:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:08:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:08:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-99db0a2a-c3cc-43cf-bdf0-6d9cf07cb227 req-3e732556-967e-4f0e-a594-f4c8ef39eef4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-changed-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:09:07 user nova-compute[76442]: DEBUG nova.compute.manager [req-99db0a2a-c3cc-43cf-bdf0-6d9cf07cb227 req-3e732556-967e-4f0e-a594-f4c8ef39eef4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Refreshing instance network info cache due to event network-changed-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:09:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-99db0a2a-c3cc-43cf-bdf0-6d9cf07cb227 req-3e732556-967e-4f0e-a594-f4c8ef39eef4 service nova] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:09:07 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-99db0a2a-c3cc-43cf-bdf0-6d9cf07cb227 req-3e732556-967e-4f0e-a594-f4c8ef39eef4 service nova] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:09:07 user nova-compute[76442]: DEBUG nova.network.neutron [req-99db0a2a-c3cc-43cf-bdf0-6d9cf07cb227 req-3e732556-967e-4f0e-a594-f4c8ef39eef4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Refreshing network info cache for port 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:09:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:08 user nova-compute[76442]: DEBUG nova.network.neutron [req-99db0a2a-c3cc-43cf-bdf0-6d9cf07cb227 req-3e732556-967e-4f0e-a594-f4c8ef39eef4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updated VIF entry in instance network info cache for port 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:09:08 user nova-compute[76442]: DEBUG nova.network.neutron [req-99db0a2a-c3cc-43cf-bdf0-6d9cf07cb227 req-3e732556-967e-4f0e-a594-f4c8ef39eef4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:09:08 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-99db0a2a-c3cc-43cf-bdf0-6d9cf07cb227 req-3e732556-967e-4f0e-a594-f4c8ef39eef4 service nova] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:09:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:10 user nova-compute[76442]: INFO nova.compute.manager [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Shelving
Nov 14 21:09:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG nova.compute.manager [req-f85ef720-b87c-4ceb-a2c7-867f02e6de28 req-2d2f4c28-e53c-4307-8eb3-166693096408 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-unplugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f85ef720-b87c-4ceb-a2c7-867f02e6de28 req-2d2f4c28-e53c-4307-8eb3-166693096408 service nova] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f85ef720-b87c-4ceb-a2c7-867f02e6de28 req-2d2f4c28-e53c-4307-8eb3-166693096408 service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f85ef720-b87c-4ceb-a2c7-867f02e6de28 req-2d2f4c28-e53c-4307-8eb3-166693096408 service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:10 user nova-compute[76442]: DEBUG nova.compute.manager [req-f85ef720-b87c-4ceb-a2c7-867f02e6de28 req-2d2f4c28-e53c-4307-8eb3-166693096408 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] No waiting events found dispatching network-vif-unplugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:09:10 user nova-compute[76442]: WARNING nova.compute.manager [req-f85ef720-b87c-4ceb-a2c7-867f02e6de28 req-2d2f4c28-e53c-4307-8eb3-166693096408 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received unexpected event network-vif-unplugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 for instance with vm_state active and task_state shelving.
Nov 14 21:09:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:11 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance destroyed successfully.
Nov 14 21:09:11 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Beginning cold snapshot process
Nov 14 21:09:11 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 21:09:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk /opt/stack/data/nova/instances/snapshots/tmpz643wwa5/328405a64fc843d588b8435f3b772d78 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk /opt/stack/data/nova/instances/snapshots/tmpz643wwa5/328405a64fc843d588b8435f3b772d78" returned: 0 in 0.546s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:11 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Snapshot extracted, beginning image upload
Nov 14 21:09:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-bd47cd86-954f-451d-9807-ee032c1f5909 req-d2825cc2-b296-4246-a0c2-65354561339f service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:09:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bd47cd86-954f-451d-9807-ee032c1f5909 req-d2825cc2-b296-4246-a0c2-65354561339f service nova] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bd47cd86-954f-451d-9807-ee032c1f5909 req-d2825cc2-b296-4246-a0c2-65354561339f service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bd47cd86-954f-451d-9807-ee032c1f5909 req-d2825cc2-b296-4246-a0c2-65354561339f service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:12 user nova-compute[76442]: DEBUG nova.compute.manager [req-bd47cd86-954f-451d-9807-ee032c1f5909 req-d2825cc2-b296-4246-a0c2-65354561339f service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] No waiting events found dispatching network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:09:12 user nova-compute[76442]: WARNING nova.compute.manager [req-bd47cd86-954f-451d-9807-ee032c1f5909 req-d2825cc2-b296-4246-a0c2-65354561339f service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received unexpected event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 21:09:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:14 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Snapshot image upload complete
Nov 14 21:09:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:09:14 user nova-compute[76442]: INFO nova.compute.manager [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Shelve offloading
Nov 14 21:09:14 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance destroyed successfully.
Nov 14 21:09:14 user nova-compute[76442]: DEBUG nova.compute.manager [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:09:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:09:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:09:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:09:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:09:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:09:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance destroyed successfully.
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.objects.instance [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'resources' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1288273930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1288273930',id=48,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+j4kvpalFxvR4qeYGA0ZBZD+ERFLswDkCwPZwJ5LzhDlvETYXxqUo94IqtD4jG/yC872nZzlEV/mk8Zaxa7a4MrCUSa8ZvOq4FdXTe8Vip50N9sWsiL4g7BJAimizMQA==',key_name='tempest-keypair-1958698388',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-v27gb2ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member',shelved_at='2023-11-14T21:09:14.374091',shelved_host='user',shelved_image_id='bdd145dc-eb61-48e7-b8d9-b0c60777ba72'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=68cabd44-d0ff-49db-89e9-e6282a25a6fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG os_vif [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00ab2ff2-d8, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ed99242-251c-4b26-b8f8-011441da978b) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-8ac18535-12d8-4123-be00-ee1293ad06d3 req-b0ff34bc-8013-406c-9f0d-8f1020f86ad4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-changed-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-8ac18535-12d8-4123-be00-ee1293ad06d3 req-b0ff34bc-8013-406c-9f0d-8f1020f86ad4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Refreshing instance network info cache due to event network-changed-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8ac18535-12d8-4123-be00-ee1293ad06d3 req-b0ff34bc-8013-406c-9f0d-8f1020f86ad4 service nova] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8ac18535-12d8-4123-be00-ee1293ad06d3 req-b0ff34bc-8013-406c-9f0d-8f1020f86ad4 service nova] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-8ac18535-12d8-4123-be00-ee1293ad06d3 req-b0ff34bc-8013-406c-9f0d-8f1020f86ad4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Refreshing network info cache for port 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:09:15 user nova-compute[76442]: INFO os_vif [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8')
Nov 14 21:09:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Deleting instance files /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb_del
Nov 14 21:09:15 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Deletion of /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb_del complete
Nov 14 21:09:15 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Deleted allocations for instance 68cabd44-d0ff-49db-89e9-e6282a25a6fb
Nov 14 21:09:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.objects.instance [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'numa_topology' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.objects.base [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<68cabd44-d0ff-49db-89e9-e6282a25a6fb> lazy-loaded attributes: resources,numa_topology {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-647be373-75f1-498d-9678-4e5b6ac40b8f tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.431s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-8ac18535-12d8-4123-be00-ee1293ad06d3 req-b0ff34bc-8013-406c-9f0d-8f1020f86ad4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updated VIF entry in instance network info cache for port 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-8ac18535-12d8-4123-be00-ee1293ad06d3 req-b0ff34bc-8013-406c-9f0d-8f1020f86ad4 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:09:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8ac18535-12d8-4123-be00-ee1293ad06d3 req-b0ff34bc-8013-406c-9f0d-8f1020f86ad4 service nova] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:09:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:23 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:26 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:09:28 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:09:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:09:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:09:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:09:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:09:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:31 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:31 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:31 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:09:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:09:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:09:31 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:09:31 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=25.10626983642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:09:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:32 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 06086205-4963-4336-8652-e93842bc8a3b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:09:32 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:09:32 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:09:32 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:09:32 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:09:32 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:09:32 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updating instance_info_cache with network_info: [{"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:09:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:38 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:09:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-78f51343-5bd9-439a-ab0f-74bff4dc0d4b req-a6c0f5f8-2f5c-4ba4-bca5-673883ba736d service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received event network-changed-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:09:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-78f51343-5bd9-439a-ab0f-74bff4dc0d4b req-a6c0f5f8-2f5c-4ba4-bca5-673883ba736d service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Refreshing instance network info cache due to event network-changed-33f7be7b-505a-4c3c-a763-68553d8af784. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:09:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-78f51343-5bd9-439a-ab0f-74bff4dc0d4b req-a6c0f5f8-2f5c-4ba4-bca5-673883ba736d service nova] Acquiring lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:09:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-78f51343-5bd9-439a-ab0f-74bff4dc0d4b req-a6c0f5f8-2f5c-4ba4-bca5-673883ba736d service nova] Acquired lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:09:39 user nova-compute[76442]: DEBUG nova.network.neutron [req-78f51343-5bd9-439a-ab0f-74bff4dc0d4b req-a6c0f5f8-2f5c-4ba4-bca5-673883ba736d service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Refreshing network info cache for port 33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:09:40 user nova-compute[76442]: DEBUG nova.network.neutron [req-78f51343-5bd9-439a-ab0f-74bff4dc0d4b req-a6c0f5f8-2f5c-4ba4-bca5-673883ba736d service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updated VIF entry in instance network info cache for port 33f7be7b-505a-4c3c-a763-68553d8af784. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:09:40 user nova-compute[76442]: DEBUG nova.network.neutron [req-78f51343-5bd9-439a-ab0f-74bff4dc0d4b req-a6c0f5f8-2f5c-4ba4-bca5-673883ba736d service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updating instance_info_cache with network_info: [{"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:09:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-78f51343-5bd9-439a-ab0f-74bff4dc0d4b req-a6c0f5f8-2f5c-4ba4-bca5-673883ba736d service nova] Releasing lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:09:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:09:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:09:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:09:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:09:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "cecb04d6-e113-4300-902f-e6ace31513fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "cecb04d6-e113-4300-902f-e6ace31513fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:43 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:09:44 user nova-compute[76442]: INFO nova.compute.claims [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Claim successful on node user
Nov 14 21:09:44 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 21:09:44 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 21:09:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG nova.policy [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f2d3fa02ad4ccbb286f49b8e59563d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcaf0b599d7c4224be5cab0f23b95157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 21:09:44 user nova-compute[76442]: INFO nova.virt.block_device [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Booting with volume a84643c3-1078-4b8c-b30c-7504699de8a0 at /dev/vda
Nov 14 21:09:44 user nova-compute[76442]: DEBUG os_brick.utils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[38228be8-c326-4b12-92a0-a33818768c8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8379b22-719f-46d1-baba-28ff4a375f55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca11301-df74-4e9d-ad40-25ab6d5d4d63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95b3e5-ea17-4f5e-a25b-229dfc4eb778]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:09:44 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:09:44 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[75873dfe-4a32-42e6-9c6f-926d10222074]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG os_brick.utils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:09:44 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Updating existing volume attachment record: 7fa0a47d-4d55-4fc3-871f-3e941a54985a {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:09:45 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Successfully created port: 1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 21:09:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:45 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Successfully updated port: 1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 21:09:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:09:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquired lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:09:45 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:09:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-d7809b14-e74c-41ec-9d57-9b2c48ab0eed req-c23879f2-31eb-4b5d-b70b-2cdfa7fe29d2 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received event network-changed-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:09:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-d7809b14-e74c-41ec-9d57-9b2c48ab0eed req-c23879f2-31eb-4b5d-b70b-2cdfa7fe29d2 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Refreshing instance network info cache due to event network-changed-1f4530e9-2063-40e5-b402-11d09c0dc478. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:09:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d7809b14-e74c-41ec-9d57-9b2c48ab0eed req-c23879f2-31eb-4b5d-b70b-2cdfa7fe29d2 service nova] Acquiring lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:09:46 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 21:09:46 user nova-compute[76442]: DEBUG nova.network.neutron [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Updating instance_info_cache with network_info: [{"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:09:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Releasing lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:09:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Instance network_info: |[{"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 21:09:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d7809b14-e74c-41ec-9d57-9b2c48ab0eed req-c23879f2-31eb-4b5d-b70b-2cdfa7fe29d2 service nova] Acquired lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:09:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-d7809b14-e74c-41ec-9d57-9b2c48ab0eed req-c23879f2-31eb-4b5d-b70b-2cdfa7fe29d2 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Refreshing network info cache for port 1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:09:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-d7809b14-e74c-41ec-9d57-9b2c48ab0eed req-c23879f2-31eb-4b5d-b70b-2cdfa7fe29d2 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Updated VIF entry in instance network info cache for port 1f4530e9-2063-40e5-b402-11d09c0dc478. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:09:46 user nova-compute[76442]: DEBUG nova.network.neutron [req-d7809b14-e74c-41ec-9d57-9b2c48ab0eed req-c23879f2-31eb-4b5d-b70b-2cdfa7fe29d2 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Updating instance_info_cache with network_info: [{"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:09:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d7809b14-e74c-41ec-9d57-9b2c48ab0eed req-c23879f2-31eb-4b5d-b70b-2cdfa7fe29d2 service nova] Releasing lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:09:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:09:49 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Creating image(s)
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Did not create local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Ensure instance console log exists: /opt/stack/data/nova/instances/cecb04d6-e113-4300-902f-e6ace31513fc/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Start _get_guest_xml network_info=[{"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPTuFZlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cecb04d6-e113-4300-902f-e6ace31513fc', 'attached_at': '', 'detached_at': '', 'volume_id': 'a84643c3-1078-4b8c-b30c-7504699de8a0', 'serial': 'a84643c3-1078-4b8c-b30c-7504699de8a0'}, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'attachment_id': '7fa0a47d-4d55-4fc3-871f-3e941a54985a', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:09:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:09:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPTuFZlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:09:49 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:09:49 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:09:49 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f21c14-17b4-4f8b-b038-03fb023299da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:09:49 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f617bc-0a5b-4307-874f-35b48bb9f715]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0] added
Nov 14 21:09:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7ee0ac-85a0-4678-a6a6-c427e6007181]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b751d5-e29d-4d05-8f79-f4560fc9f3f5]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPTuFZlA {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qPTuFZlA" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[86306af2-7a5d-45de-b4be-c1fd5831e772]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qPTuFZlA'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bd2d8d-9c60-4a70-bb01-afa283bc0199]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de0e30e-7cea-488e-ba70-4a4616caeca4]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:09:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:09:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a8afd4-10b6-4c25-aedb-d8fa6f9a0711]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0, portal: 172.16.0.220,3260]
Nov 14 21:09:49 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0, portal: 172.16.0.220,3260] successful.
Nov 14 21:09:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04a343-c3a4-4d15-9f56-9f54ded723bf]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8c46f8-7964-4d7a-842f-481a8679b0f9]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:09:49 user nova-compute[76442]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 (non-flash)
Nov 14 21:09:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:09:49 user nova-compute[76442]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 (non-flash)
Nov 14 21:09:49 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aa8106-e0d1-4c57-b90c-6566de7f2544]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:09:49 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPTuFZlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26364663937623466', 'path': '/dev/sdc'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364663937623466', 'path': '/dev/sdc'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-172187616',display_name='tempest-TestVolumeBootPattern-server-172187616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-172187616',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMqtgJcFo+NzjA+7zu6HEvMzvBBa7Tnf+vJ5z+1XXrfQbhOVQpKiDoQUweMd2Q4UWCll8fgk22nliL1Wnofn524UJjbOUqMcyJZsIShi3LXF6K6AvSqhcjKFsOqpiDXyA==',key_name='tempest-TestVolumeBootPattern-280068245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-huxtl84e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:09:44Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=cecb04d6-e113-4300-902f-e6ace31513fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=1f4530e9-2063-40e5-b402-11d09c0dc478,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4530e9-20') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.objects.instance [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'pci_devices' on Instance uuid cecb04d6-e113-4300-902f-e6ace31513fc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:09:50 user nova-compute[76442]:   <uuid>cecb04d6-e113-4300-902f-e6ace31513fc</uuid>
Nov 14 21:09:50 user nova-compute[76442]:   <name>instance-00000032</name>
Nov 14 21:09:50 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:09:50 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:09:50 user nova-compute[76442]:   <metadata>
Nov 14 21:09:50 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:09:50 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:09:50 user nova-compute[76442]:       <nova:name>tempest-TestVolumeBootPattern-server-172187616</nova:name>
Nov 14 21:09:50 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:09:49</nova:creationTime>
Nov 14 21:09:50 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:09:50 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:09:50 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:09:50 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:09:50 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:09:50 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:09:50 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:09:50 user nova-compute[76442]:       <nova:owner>
Nov 14 21:09:50 user nova-compute[76442]:         <nova:user uuid="85f2d3fa02ad4ccbb286f49b8e59563d">tempest-TestVolumeBootPattern-792728264-project-member</nova:user>
Nov 14 21:09:50 user nova-compute[76442]:         <nova:project uuid="bcaf0b599d7c4224be5cab0f23b95157">tempest-TestVolumeBootPattern-792728264</nova:project>
Nov 14 21:09:50 user nova-compute[76442]:       </nova:owner>
Nov 14 21:09:50 user nova-compute[76442]:       <nova:ports>
Nov 14 21:09:50 user nova-compute[76442]:         <nova:port uuid="1f4530e9-2063-40e5-b402-11d09c0dc478">
Nov 14 21:09:50 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 21:09:50 user nova-compute[76442]:         </nova:port>
Nov 14 21:09:50 user nova-compute[76442]:       </nova:ports>
Nov 14 21:09:50 user nova-compute[76442]:     </nova:instance>
Nov 14 21:09:50 user nova-compute[76442]:   </metadata>
Nov 14 21:09:50 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:09:50 user nova-compute[76442]:     <system>
Nov 14 21:09:50 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:09:50 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:09:50 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:09:50 user nova-compute[76442]:       <entry name="serial">cecb04d6-e113-4300-902f-e6ace31513fc</entry>
Nov 14 21:09:50 user nova-compute[76442]:       <entry name="uuid">cecb04d6-e113-4300-902f-e6ace31513fc</entry>
Nov 14 21:09:50 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:09:50 user nova-compute[76442]:     </system>
Nov 14 21:09:50 user nova-compute[76442]:   </sysinfo>
Nov 14 21:09:50 user nova-compute[76442]:   <os>
Nov 14 21:09:50 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:09:50 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:09:50 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:09:50 user nova-compute[76442]:   </os>
Nov 14 21:09:50 user nova-compute[76442]:   <features>
Nov 14 21:09:50 user nova-compute[76442]:     <acpi/>
Nov 14 21:09:50 user nova-compute[76442]:     <apic/>
Nov 14 21:09:50 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:09:50 user nova-compute[76442]:   </features>
Nov 14 21:09:50 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:09:50 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:09:50 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:09:50 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:09:50 user nova-compute[76442]:   </clock>
Nov 14 21:09:50 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:09:50 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:09:50 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:09:50 user nova-compute[76442]:   </cpu>
Nov 14 21:09:50 user nova-compute[76442]:   <devices>
Nov 14 21:09:50 user nova-compute[76442]:     <disk type="block" device="disk">
Nov 14 21:09:50 user nova-compute[76442]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:09:50 user nova-compute[76442]:       <source dev="/dev/sdc"/>
Nov 14 21:09:50 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:09:50 user nova-compute[76442]:       <serial>a84643c3-1078-4b8c-b30c-7504699de8a0</serial>
Nov 14 21:09:50 user nova-compute[76442]:     </disk>
Nov 14 21:09:50 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:09:50 user nova-compute[76442]:       <mac address="fa:16:3e:de:10:1e"/>
Nov 14 21:09:50 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:09:50 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:09:50 user nova-compute[76442]:       <target dev="tap1f4530e9-20"/>
Nov 14 21:09:50 user nova-compute[76442]:     </interface>
Nov 14 21:09:50 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:09:50 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/cecb04d6-e113-4300-902f-e6ace31513fc/console.log" append="off"/>
Nov 14 21:09:50 user nova-compute[76442]:     </serial>
Nov 14 21:09:50 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:09:50 user nova-compute[76442]:     <video>
Nov 14 21:09:50 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:09:50 user nova-compute[76442]:     </video>
Nov 14 21:09:50 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:09:50 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:09:50 user nova-compute[76442]:     </rng>
Nov 14 21:09:50 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:09:50 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:09:50 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:09:50 user nova-compute[76442]:     </memballoon>
Nov 14 21:09:50 user nova-compute[76442]:   </devices>
Nov 14 21:09:50 user nova-compute[76442]: </domain>
Nov 14 21:09:50 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-172187616',display_name='tempest-TestVolumeBootPattern-server-172187616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-172187616',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMqtgJcFo+NzjA+7zu6HEvMzvBBa7Tnf+vJ5z+1XXrfQbhOVQpKiDoQUweMd2Q4UWCll8fgk22nliL1Wnofn524UJjbOUqMcyJZsIShi3LXF6K6AvSqhcjKFsOqpiDXyA==',key_name='tempest-TestVolumeBootPattern-280068245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-huxtl84e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:09:44Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=cecb04d6-e113-4300-902f-e6ace31513fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=1f4530e9-2063-40e5-b402-11d09c0dc478,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4530e9-20') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG os_vif [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=1f4530e9-2063-40e5-b402-11d09c0dc478,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4530e9-20') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e190343-c103-5991-8bb2-dc86b992d361', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f4530e9-20, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f4530e9-20, col_values=(('qos', UUID('36cca71b-3145-4acf-a9e0-abe4fcae7c63')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f4530e9-20, col_values=(('external_ids', {'iface-id': '1f4530e9-2063-40e5-b402-11d09c0dc478', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:10:1e', 'vm-uuid': 'cecb04d6-e113-4300-902f-e6ace31513fc'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:50 user nova-compute[76442]: INFO os_vif [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=1f4530e9-2063-40e5-b402-11d09c0dc478,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4530e9-20')
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:09:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] No VIF found with MAC fa:16:3e:de:10:1e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:09:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-a26d550d-83b6-4d96-a43e-ffd05fc8c9ed req-bd51d5e8-0da1-4864-985c-c1a4babb73b6 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received event network-vif-plugged-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:09:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a26d550d-83b6-4d96-a43e-ffd05fc8c9ed req-bd51d5e8-0da1-4864-985c-c1a4babb73b6 service nova] Acquiring lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a26d550d-83b6-4d96-a43e-ffd05fc8c9ed req-bd51d5e8-0da1-4864-985c-c1a4babb73b6 service nova] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a26d550d-83b6-4d96-a43e-ffd05fc8c9ed req-bd51d5e8-0da1-4864-985c-c1a4babb73b6 service nova] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:52 user nova-compute[76442]: DEBUG nova.compute.manager [req-a26d550d-83b6-4d96-a43e-ffd05fc8c9ed req-bd51d5e8-0da1-4864-985c-c1a4babb73b6 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] No waiting events found dispatching network-vif-plugged-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:09:52 user nova-compute[76442]: WARNING nova.compute.manager [req-a26d550d-83b6-4d96-a43e-ffd05fc8c9ed req-bd51d5e8-0da1-4864-985c-c1a4babb73b6 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received unexpected event network-vif-plugged-1f4530e9-2063-40e5-b402-11d09c0dc478 for instance with vm_state building and task_state spawning.
Nov 14 21:09:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:09:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:09:53 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Instance spawned successfully.
Nov 14 21:09:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 21:09:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:09:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:09:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:09:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:09:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:09:53 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:09:54 user nova-compute[76442]: INFO nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 14 21:09:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:09:54 user nova-compute[76442]: INFO nova.compute.manager [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Took 10.06 seconds to build instance.
Nov 14 21:09:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1bbb1238-8617-4990-a599-7a71892f269b tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "cecb04d6-e113-4300-902f-e6ace31513fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.167s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-bea7d8ff-e555-4e4f-ac48-c9ce344dcf65 req-d4d6a632-9ae2-4374-af12-4948550f99be service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received event network-vif-plugged-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:09:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bea7d8ff-e555-4e4f-ac48-c9ce344dcf65 req-d4d6a632-9ae2-4374-af12-4948550f99be service nova] Acquiring lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:09:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bea7d8ff-e555-4e4f-ac48-c9ce344dcf65 req-d4d6a632-9ae2-4374-af12-4948550f99be service nova] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:09:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bea7d8ff-e555-4e4f-ac48-c9ce344dcf65 req-d4d6a632-9ae2-4374-af12-4948550f99be service nova] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:09:54 user nova-compute[76442]: DEBUG nova.compute.manager [req-bea7d8ff-e555-4e4f-ac48-c9ce344dcf65 req-d4d6a632-9ae2-4374-af12-4948550f99be service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] No waiting events found dispatching network-vif-plugged-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:09:54 user nova-compute[76442]: WARNING nova.compute.manager [req-bea7d8ff-e555-4e4f-ac48-c9ce344dcf65 req-d4d6a632-9ae2-4374-af12-4948550f99be service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received unexpected event network-vif-plugged-1f4530e9-2063-40e5-b402-11d09c0dc478 for instance with vm_state active and task_state None.
Nov 14 21:09:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:09:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:10:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:25 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:26 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:28 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:28 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:28 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:10:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:10:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:10:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:10:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:10:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:10:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:10:33 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:10:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:10:33 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:10:34 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:10:34 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:10:34 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8863MB free_disk=25.1043701171875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 06086205-4963-4336-8652-e93842bc8a3b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance cecb04d6-e113-4300-902f-e6ace31513fc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:10:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:10:35 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 06086205-4963-4336-8652-e93842bc8a3b {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:10:36 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updating instance_info_cache with network_info: [{"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:10:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:10:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:10:40 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:10:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:10:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:10:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:10:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:10:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Verify base images {{(pid=76442) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=76442) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] 06086205-4963-4336-8652-e93842bc8a3b is a valid instance name {{(pid=76442) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] cecb04d6-e113-4300-902f-e6ace31513fc is a valid instance name {{(pid=76442) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 21:10:50 user nova-compute[76442]: WARNING nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Unknown base file: /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd
Nov 14 21:10:50 user nova-compute[76442]: WARNING nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Unknown base file: /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8
Nov 14 21:10:50 user nova-compute[76442]: WARNING nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Unknown base file: /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03
Nov 14 21:10:50 user nova-compute[76442]: WARNING nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Unknown base file: /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28
Nov 14 21:10:50 user nova-compute[76442]: WARNING nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Unknown base file: /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8
Nov 14 21:10:50 user nova-compute[76442]: WARNING nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Unknown base file: /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437
Nov 14 21:10:50 user nova-compute[76442]: WARNING nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Unknown base file: /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987
Nov 14 21:10:50 user nova-compute[76442]: WARNING nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Unknown base file: /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6
Nov 14 21:10:50 user nova-compute[76442]: WARNING nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Unknown base file: /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Removable base files: /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8 /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03 /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28 /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8 /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437 /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987 /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3189bbccb258345605ee17c3bdc44d3b13d135bd
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/76a89d36026077b342946c339898432faed956e8
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a14defe8e96f184ed36869f7a137f133862cdd03
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c9d4f5fd7c788c33f29ae5ed67f8dda1ee7d4b28
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ce107f827be52b960e0c9efb1a4200695b018bd8
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dfc994199dc7e57c2dd5cbb9545c4af82c00a437
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/957a671ff535b421fc0857dae43576e9d6d3a987
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6
Nov 14 21:10:50 user nova-compute[76442]: INFO nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bba80c14c7e7b81a853bbb7297d257702b853c31
Nov 14 21:10:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Verification complete {{(pid=76442) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Verify swap images {{(pid=76442) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG nova.virt.libvirt.imagecache [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Verify ephemeral images {{(pid=76442) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 21:10:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:10:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:10:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:10:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:10:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:11:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:11:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:11:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:11:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:11:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:02 user nova-compute[76442]: INFO nova.compute.manager [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Unshelving
Nov 14 21:11:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:03 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'pci_requests' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:11:03 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'numa_topology' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:11:03 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:11:03 user nova-compute[76442]: INFO nova.compute.claims [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Claim successful on node user
Nov 14 21:11:03 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:11:03 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:11:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:03 user nova-compute[76442]: INFO nova.network.neutron [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating port 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 21:11:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-cec31825-0b46-4cf4-b315-2218c06eb1b4 req-16b78940-336f-4b15-9268-638ee3389243 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-changed-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-cec31825-0b46-4cf4-b315-2218c06eb1b4 req-16b78940-336f-4b15-9268-638ee3389243 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Refreshing instance network info cache due to event network-changed-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cec31825-0b46-4cf4-b315-2218c06eb1b4 req-16b78940-336f-4b15-9268-638ee3389243 service nova] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG nova.network.neutron [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:11:04 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Creating image(s)
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cec31825-0b46-4cf4-b315-2218c06eb1b4 req-16b78940-336f-4b15-9268-638ee3389243 service nova] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG nova.network.neutron [req-cec31825-0b46-4cf4-b315-2218c06eb1b4 req-16b78940-336f-4b15-9268-638ee3389243 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Refreshing network info cache for port 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG nova.objects.base [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<68cabd44-d0ff-49db-89e9-e6282a25a6fb> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "b01a90e8bfe3f5d8f0bfec916f296b50fd210521" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "b01a90e8bfe3f5d8f0bfec916f296b50fd210521" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521.part --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521.part --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:05 user nova-compute[76442]: DEBUG nova.virt.images [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] bdd145dc-eb61-48e7-b8d9-b0c60777ba72 was qcow2, converting to raw {{(pid=76442) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 21:11:05 user nova-compute[76442]: DEBUG nova.privsep.utils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76442) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 21:11:05 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521.part /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521.converted {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-cec31825-0b46-4cf4-b315-2218c06eb1b4 req-16b78940-336f-4b15-9268-638ee3389243 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updated VIF entry in instance network info cache for port 00ab2ff2-d8cd-43ea-bde7-286df17ad6d6. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:11:05 user nova-compute[76442]: DEBUG nova.network.neutron [req-cec31825-0b46-4cf4-b315-2218c06eb1b4 req-16b78940-336f-4b15-9268-638ee3389243 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:11:05 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-cec31825-0b46-4cf4-b315-2218c06eb1b4 req-16b78940-336f-4b15-9268-638ee3389243 service nova] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521.part /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521.converted" returned: 0 in 0.534s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521.converted --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "b01a90e8bfe3f5d8f0bfec916f296b50fd210521" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.795s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521 --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "b01a90e8bfe3f5d8f0bfec916f296b50fd210521" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "b01a90e8bfe3f5d8f0bfec916f296b50fd210521" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521 --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521,backing_fmt=raw /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521,backing_fmt=raw /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk 1073741824" returned: 0 in 0.055s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "b01a90e8bfe3f5d8f0bfec916f296b50fd210521" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b01a90e8bfe3f5d8f0bfec916f296b50fd210521 --force-share --output=json" returned: 0 in 0.166s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'migration_context' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:11:06 user nova-compute[76442]: DEBUG nova.objects.base [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<68cabd44-d0ff-49db-89e9-e6282a25a6fb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:11:06 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Rebasing disk image.
Nov 14 21:11:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.164s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:07 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 -F raw /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:08 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 -F raw /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk" returned: 0 in 1.922s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:08 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Ensure instance console log exists: /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Start _get_guest_xml network_info=[{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1f2dbd7eabed9fa3bd47482cab43d0de',container_format='bare',created_at=2023-11-14T21:09:10Z,direct_url=<?>,disk_format='qcow2',id=bdd145dc-eb61-48e7-b8d9-b0c60777ba72,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1288273930-shelved',owner='04176df08b194d959611acf480360493',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T21:09:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:11:09 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:11:09 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1f2dbd7eabed9fa3bd47482cab43d0de',container_format='bare',created_at=2023-11-14T21:09:10Z,direct_url=<?>,disk_format='qcow2',id=bdd145dc-eb61-48e7-b8d9-b0c60777ba72,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1288273930-shelved',owner='04176df08b194d959611acf480360493',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T21:09:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.objects.base [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<68cabd44-d0ff-49db-89e9-e6282a25a6fb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T21:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1288273930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1288273930',id=48,image_ref='bdd145dc-eb61-48e7-b8d9-b0c60777ba72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1958698388',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-v27gb2ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member',shelved_at='2023-11-14T21:09:14.374091',shelved_host='user',shelved_image_id='bdd145dc-eb61-48e7-b8d9-b0c60777ba72'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=68cabd44-d0ff-49db-89e9-e6282a25a6fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'pci_devices' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.objects.base [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Object Instance<68cabd44-d0ff-49db-89e9-e6282a25a6fb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76442) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:11:09 user nova-compute[76442]:   <uuid>68cabd44-d0ff-49db-89e9-e6282a25a6fb</uuid>
Nov 14 21:11:09 user nova-compute[76442]:   <name>instance-00000030</name>
Nov 14 21:11:09 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:11:09 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:11:09 user nova-compute[76442]:   <metadata>
Nov 14 21:11:09 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:11:09 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:11:09 user nova-compute[76442]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1288273930</nova:name>
Nov 14 21:11:09 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:11:09</nova:creationTime>
Nov 14 21:11:09 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:11:09 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:11:09 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:11:09 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:11:09 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:11:09 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:11:09 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:11:09 user nova-compute[76442]:       <nova:owner>
Nov 14 21:11:09 user nova-compute[76442]:         <nova:user uuid="eb9d2e0b8d7b4bdf94872e2186dfad31">tempest-AttachVolumeShelveTestJSON-1848978120-project-member</nova:user>
Nov 14 21:11:09 user nova-compute[76442]:         <nova:project uuid="04176df08b194d959611acf480360493">tempest-AttachVolumeShelveTestJSON-1848978120</nova:project>
Nov 14 21:11:09 user nova-compute[76442]:       </nova:owner>
Nov 14 21:11:09 user nova-compute[76442]:       <nova:root type="image" uuid="bdd145dc-eb61-48e7-b8d9-b0c60777ba72"/>
Nov 14 21:11:09 user nova-compute[76442]:       <nova:ports>
Nov 14 21:11:09 user nova-compute[76442]:         <nova:port uuid="00ab2ff2-d8cd-43ea-bde7-286df17ad6d6">
Nov 14 21:11:09 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 21:11:09 user nova-compute[76442]:         </nova:port>
Nov 14 21:11:09 user nova-compute[76442]:       </nova:ports>
Nov 14 21:11:09 user nova-compute[76442]:     </nova:instance>
Nov 14 21:11:09 user nova-compute[76442]:   </metadata>
Nov 14 21:11:09 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:11:09 user nova-compute[76442]:     <system>
Nov 14 21:11:09 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:11:09 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:11:09 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:11:09 user nova-compute[76442]:       <entry name="serial">68cabd44-d0ff-49db-89e9-e6282a25a6fb</entry>
Nov 14 21:11:09 user nova-compute[76442]:       <entry name="uuid">68cabd44-d0ff-49db-89e9-e6282a25a6fb</entry>
Nov 14 21:11:09 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:11:09 user nova-compute[76442]:     </system>
Nov 14 21:11:09 user nova-compute[76442]:   </sysinfo>
Nov 14 21:11:09 user nova-compute[76442]:   <os>
Nov 14 21:11:09 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:11:09 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:11:09 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:11:09 user nova-compute[76442]:   </os>
Nov 14 21:11:09 user nova-compute[76442]:   <features>
Nov 14 21:11:09 user nova-compute[76442]:     <acpi/>
Nov 14 21:11:09 user nova-compute[76442]:     <apic/>
Nov 14 21:11:09 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:11:09 user nova-compute[76442]:   </features>
Nov 14 21:11:09 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:11:09 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:11:09 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:11:09 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:11:09 user nova-compute[76442]:   </clock>
Nov 14 21:11:09 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:11:09 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:11:09 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:11:09 user nova-compute[76442]:   </cpu>
Nov 14 21:11:09 user nova-compute[76442]:   <devices>
Nov 14 21:11:09 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 21:11:09 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 21:11:09 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk"/>
Nov 14 21:11:09 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:11:09 user nova-compute[76442]:     </disk>
Nov 14 21:11:09 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:11:09 user nova-compute[76442]:       <mac address="fa:16:3e:43:ed:6e"/>
Nov 14 21:11:09 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:11:09 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:11:09 user nova-compute[76442]:       <target dev="tap00ab2ff2-d8"/>
Nov 14 21:11:09 user nova-compute[76442]:     </interface>
Nov 14 21:11:09 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:11:09 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/console.log" append="off"/>
Nov 14 21:11:09 user nova-compute[76442]:     </serial>
Nov 14 21:11:09 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:11:09 user nova-compute[76442]:     <video>
Nov 14 21:11:09 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:11:09 user nova-compute[76442]:     </video>
Nov 14 21:11:09 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:11:09 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:11:09 user nova-compute[76442]:     </rng>
Nov 14 21:11:09 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:11:09 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:11:09 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:11:09 user nova-compute[76442]:     </memballoon>
Nov 14 21:11:09 user nova-compute[76442]:   </devices>
Nov 14 21:11:09 user nova-compute[76442]: </domain>
Nov 14 21:11:09 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T21:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1288273930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1288273930',id=48,image_ref='bdd145dc-eb61-48e7-b8d9-b0c60777ba72',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1958698388',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-v27gb2ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member',shelved_at='2023-11-14T21:09:14.374091',shelved_host='user',shelved_image_id='bdd145dc-eb61-48e7-b8d9-b0c60777ba72'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=68cabd44-d0ff-49db-89e9-e6282a25a6fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG os_vif [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94526910-dc24-5f2d-9125-982a6f1aac7d', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00ab2ff2-d8, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00ab2ff2-d8, col_values=(('qos', UUID('0ccfcfb3-286e-4178-8d33-5917f186b722')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00ab2ff2-d8, col_values=(('external_ids', {'iface-id': '00ab2ff2-d8cd-43ea-bde7-286df17ad6d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:ed:6e', 'vm-uuid': '68cabd44-d0ff-49db-89e9-e6282a25a6fb'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:09 user nova-compute[76442]: INFO os_vif [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8')
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:11:09 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] No VIF found with MAC fa:16:3e:43:ed:6e, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-d5a2d776-46ac-48e9-b912-f3fcf13e21cc req-3d01b675-4217-4159-9699-7b876de1baaa service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d5a2d776-46ac-48e9-b912-f3fcf13e21cc req-3d01b675-4217-4159-9699-7b876de1baaa service nova] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d5a2d776-46ac-48e9-b912-f3fcf13e21cc req-3d01b675-4217-4159-9699-7b876de1baaa service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d5a2d776-46ac-48e9-b912-f3fcf13e21cc req-3d01b675-4217-4159-9699-7b876de1baaa service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG nova.compute.manager [req-d5a2d776-46ac-48e9-b912-f3fcf13e21cc req-3d01b675-4217-4159-9699-7b876de1baaa service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] No waiting events found dispatching network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:11:11 user nova-compute[76442]: WARNING nova.compute.manager [req-d5a2d776-46ac-48e9-b912-f3fcf13e21cc req-3d01b675-4217-4159-9699-7b876de1baaa service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received unexpected event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 21:11:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:11:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:11:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance spawned successfully.
Nov 14 21:11:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6aed6f9-0728-4c51-acc9-0558288416b7 req-72f2a9d1-b6d3-40eb-95ab-006f4d6ac30d service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:11:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6aed6f9-0728-4c51-acc9-0558288416b7 req-72f2a9d1-b6d3-40eb-95ab-006f4d6ac30d service nova] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6aed6f9-0728-4c51-acc9-0558288416b7 req-72f2a9d1-b6d3-40eb-95ab-006f4d6ac30d service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6aed6f9-0728-4c51-acc9-0558288416b7 req-72f2a9d1-b6d3-40eb-95ab-006f4d6ac30d service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6aed6f9-0728-4c51-acc9-0558288416b7 req-72f2a9d1-b6d3-40eb-95ab-006f4d6ac30d service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] No waiting events found dispatching network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:11:13 user nova-compute[76442]: WARNING nova.compute.manager [req-c6aed6f9-0728-4c51-acc9-0558288416b7 req-72f2a9d1-b6d3-40eb-95ab-006f4d6ac30d service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received unexpected event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 21:11:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:11:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f1ec0a42-e931-492a-af39-c5117e4fcbc7 tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.782s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_power_states {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 06086205-4963-4336-8652-e93842bc8a3b {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid cecb04d6-e113-4300-902f-e6ace31513fc {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "06086205-4963-4336-8652-e93842bc8a3b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "06086205-4963-4336-8652-e93842bc8a3b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "cecb04d6-e113-4300-902f-e6ace31513fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "cecb04d6-e113-4300-902f-e6ace31513fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "06086205-4963-4336-8652-e93842bc8a3b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "cecb04d6-e113-4300-902f-e6ace31513fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:11:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76442) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:34 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:35 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:11:35 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.070327758789062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-0df9746f-8ec8-49bf-afb2-e5e710525205 req-43bd38b5-1b38-4821-87af-aff6647f87b7 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received event network-changed-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.manager [req-0df9746f-8ec8-49bf-afb2-e5e710525205 req-43bd38b5-1b38-4821-87af-aff6647f87b7 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Refreshing instance network info cache due to event network-changed-1f4530e9-2063-40e5-b402-11d09c0dc478. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0df9746f-8ec8-49bf-afb2-e5e710525205 req-43bd38b5-1b38-4821-87af-aff6647f87b7 service nova] Acquiring lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0df9746f-8ec8-49bf-afb2-e5e710525205 req-43bd38b5-1b38-4821-87af-aff6647f87b7 service nova] Acquired lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.network.neutron [req-0df9746f-8ec8-49bf-afb2-e5e710525205 req-43bd38b5-1b38-4821-87af-aff6647f87b7 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Refreshing network info cache for port 1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 06086205-4963-4336-8652-e93842bc8a3b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance cecb04d6-e113-4300-902f-e6ace31513fc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 68cabd44-d0ff-49db-89e9-e6282a25a6fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:11:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG nova.network.neutron [req-0df9746f-8ec8-49bf-afb2-e5e710525205 req-43bd38b5-1b38-4821-87af-aff6647f87b7 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Updated VIF entry in instance network info cache for port 1f4530e9-2063-40e5-b402-11d09c0dc478. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG nova.network.neutron [req-0df9746f-8ec8-49bf-afb2-e5e710525205 req-43bd38b5-1b38-4821-87af-aff6647f87b7 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Updating instance_info_cache with network_info: [{"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-0df9746f-8ec8-49bf-afb2-e5e710525205 req-43bd38b5-1b38-4821-87af-aff6647f87b7 service nova] Releasing lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6cb8c0d-9687-43a4-9211-daccf6494900 req-b1d98d5a-0b06-44b0-8dd1-d8393c0ca6bc service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received event network-changed-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG nova.compute.manager [req-c6cb8c0d-9687-43a4-9211-daccf6494900 req-b1d98d5a-0b06-44b0-8dd1-d8393c0ca6bc service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Refreshing instance network info cache due to event network-changed-1f4530e9-2063-40e5-b402-11d09c0dc478. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6cb8c0d-9687-43a4-9211-daccf6494900 req-b1d98d5a-0b06-44b0-8dd1-d8393c0ca6bc service nova] Acquiring lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6cb8c0d-9687-43a4-9211-daccf6494900 req-b1d98d5a-0b06-44b0-8dd1-d8393c0ca6bc service nova] Acquired lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG nova.network.neutron [req-c6cb8c0d-9687-43a4-9211-daccf6494900 req-b1d98d5a-0b06-44b0-8dd1-d8393c0ca6bc service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Refreshing network info cache for port 1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "cecb04d6-e113-4300-902f-e6ace31513fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "cecb04d6-e113-4300-902f-e6ace31513fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:36 user nova-compute[76442]: INFO nova.compute.manager [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Terminating instance
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-9f69f214-1511-4142-b070-e8ae3bc438aa req-5bf18625-643c-4154-9305-fe43d3cc33a8 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received event network-vif-unplugged-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9f69f214-1511-4142-b070-e8ae3bc438aa req-5bf18625-643c-4154-9305-fe43d3cc33a8 service nova] Acquiring lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9f69f214-1511-4142-b070-e8ae3bc438aa req-5bf18625-643c-4154-9305-fe43d3cc33a8 service nova] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-9f69f214-1511-4142-b070-e8ae3bc438aa req-5bf18625-643c-4154-9305-fe43d3cc33a8 service nova] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-9f69f214-1511-4142-b070-e8ae3bc438aa req-5bf18625-643c-4154-9305-fe43d3cc33a8 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] No waiting events found dispatching network-vif-unplugged-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.compute.manager [req-9f69f214-1511-4142-b070-e8ae3bc438aa req-5bf18625-643c-4154-9305-fe43d3cc33a8 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received event network-vif-unplugged-1f4530e9-2063-40e5-b402-11d09c0dc478 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.network.neutron [req-c6cb8c0d-9687-43a4-9211-daccf6494900 req-b1d98d5a-0b06-44b0-8dd1-d8393c0ca6bc service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Updated VIF entry in instance network info cache for port 1f4530e9-2063-40e5-b402-11d09c0dc478. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.network.neutron [req-c6cb8c0d-9687-43a4-9211-daccf6494900 req-b1d98d5a-0b06-44b0-8dd1-d8393c0ca6bc service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Updating instance_info_cache with network_info: [{"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-c6cb8c0d-9687-43a4-9211-daccf6494900 req-b1d98d5a-0b06-44b0-8dd1-d8393c0ca6bc service nova] Releasing lock "refresh_cache-cecb04d6-e113-4300-902f-e6ace31513fc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Instance destroyed successfully.
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.objects.instance [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'resources' on Instance uuid cecb04d6-e113-4300-902f-e6ace31513fc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-172187616',display_name='tempest-TestVolumeBootPattern-server-172187616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-172187616',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMqtgJcFo+NzjA+7zu6HEvMzvBBa7Tnf+vJ5z+1XXrfQbhOVQpKiDoQUweMd2Q4UWCll8fgk22nliL1Wnofn524UJjbOUqMcyJZsIShi3LXF6K6AvSqhcjKFsOqpiDXyA==',key_name='tempest-TestVolumeBootPattern-280068245',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-huxtl84e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:09:54Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=cecb04d6-e113-4300-902f-e6ace31513fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "1f4530e9-2063-40e5-b402-11d09c0dc478", "address": "fa:16:3e:de:10:1e", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4530e9-20", "ovs_interfaceid": "1f4530e9-2063-40e5-b402-11d09c0dc478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=1f4530e9-2063-40e5-b402-11d09c0dc478,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4530e9-20') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_vif [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=1f4530e9-2063-40e5-b402-11d09c0dc478,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4530e9-20') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f4530e9-20, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36cca71b-3145-4acf-a9e0-abe4fcae7c63) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:11:37 user nova-compute[76442]: INFO os_vif [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=1f4530e9-2063-40e5-b402-11d09c0dc478,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4530e9-20')
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qPTuFZlA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:11:37 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0087d7-22cc-4441-8d4f-62bab10ce0e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:11:37 user nova-compute[76442]: No targets found.
Nov 14 21:11:37 user nova-compute[76442]: iSNS:
Nov 14 21:11:37 user nova-compute[76442]: No targets found.
Nov 14 21:11:37 user nova-compute[76442]: STATIC:
Nov 14 21:11:37 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44
Nov 14 21:11:37 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:11:37 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:11:37 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0
Nov 14 21:11:37 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:11:37 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:11:37 user nova-compute[76442]: FIRMWARE:
Nov 14 21:11:37 user nova-compute[76442]: No targets found.
Nov 14 21:11:37 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:11:37 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:11:37 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[377f464f-1eff-4cf4-b2a4-846096cfc54b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a09ae85-08ad-4f29-80e9-ae1c53992352]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:11:37 user nova-compute[76442]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 (non-flash)
Nov 14 21:11:37 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:11:37 user nova-compute[76442]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 (non-flash)
Nov 14 21:11:37 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e84b3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0'): ({'sdc'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Removing single pathed devices sdc {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.057s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e701a31a-c975-4a9f-8934-7c7dd6c919c8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[119686ce-f580-48b1-b5be-3289dbde32fc]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flushing IO for device /dev/sdc {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e07382-962b-4578-905c-0c2ae6041505]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Skipping network cache update for instance because it is being deleted. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[af34a6c0-7343-457a-b66c-1c917f868561]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] SCSI volumes sdc have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[211785ec-940f-42c4-936d-f5974302e00d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[df14d814-3da3-4916-a90c-77bc59c998c4]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0, portal: 172.16.0.220,3260]
Nov 14 21:11:37 user nova-compute[76442]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0, portal: 172.16.0.220,3260] successful.
Nov 14 21:11:37 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84643c3-1078-4b8c-b30c-7504699de8a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ea047e-21f6-42bf-a80a-19aea1177a97]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== disconnect_volume: return (348ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:11:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Deleting instance files /opt/stack/data/nova/instances/cecb04d6-e113-4300-902f-e6ace31513fc_del
Nov 14 21:11:37 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Deletion of /opt/stack/data/nova/instances/cecb04d6-e113-4300-902f-e6ace31513fc_del complete
Nov 14 21:11:37 user nova-compute[76442]: INFO nova.compute.manager [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 21:11:37 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:11:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:38 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:11:38 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Took 0.38 seconds to deallocate network for instance.
Nov 14 21:11:38 user nova-compute[76442]: INFO nova.compute.manager [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 21:11:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:39 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:11:39 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:11:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-ea231fc2-7ebb-4254-bb2a-05d34f65f482 req-6d6fa989-1211-4e81-bf07-caad05ee1fc5 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received event network-vif-plugged-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:11:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ea231fc2-7ebb-4254-bb2a-05d34f65f482 req-6d6fa989-1211-4e81-bf07-caad05ee1fc5 service nova] Acquiring lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:11:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ea231fc2-7ebb-4254-bb2a-05d34f65f482 req-6d6fa989-1211-4e81-bf07-caad05ee1fc5 service nova] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:11:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-ea231fc2-7ebb-4254-bb2a-05d34f65f482 req-6d6fa989-1211-4e81-bf07-caad05ee1fc5 service nova] Lock "cecb04d6-e113-4300-902f-e6ace31513fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-ea231fc2-7ebb-4254-bb2a-05d34f65f482 req-6d6fa989-1211-4e81-bf07-caad05ee1fc5 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] No waiting events found dispatching network-vif-plugged-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:11:39 user nova-compute[76442]: WARNING nova.compute.manager [req-ea231fc2-7ebb-4254-bb2a-05d34f65f482 req-6d6fa989-1211-4e81-bf07-caad05ee1fc5 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received unexpected event network-vif-plugged-1f4530e9-2063-40e5-b402-11d09c0dc478 for instance with vm_state deleted and task_state None.
Nov 14 21:11:39 user nova-compute[76442]: DEBUG nova.compute.manager [req-ea231fc2-7ebb-4254-bb2a-05d34f65f482 req-6d6fa989-1211-4e81-bf07-caad05ee1fc5 service nova] [instance: cecb04d6-e113-4300-902f-e6ace31513fc] Received event network-vif-deleted-1f4530e9-2063-40e5-b402-11d09c0dc478 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:11:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:39 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Deleted allocations for instance cecb04d6-e113-4300-902f-e6ace31513fc
Nov 14 21:11:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91316859-e536-4bc5-a947-baefd6f81ba1 tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "cecb04d6-e113-4300-902f-e6ace31513fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.728s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:11:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:42 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:11:49 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:11:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 21:11:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:11:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:12:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:12:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:12:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:12:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:12:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:12:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:27 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:12:28 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:12:29 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:12:29 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG nova.compute.manager [req-546dce21-3c8a-422f-9abc-c54bd8f260b9 req-509c720a-b65a-456b-95cf-7dd57556b19c service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received event network-changed-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG nova.compute.manager [req-546dce21-3c8a-422f-9abc-c54bd8f260b9 req-509c720a-b65a-456b-95cf-7dd57556b19c service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Refreshing instance network info cache due to event network-changed-33f7be7b-505a-4c3c-a763-68553d8af784. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-546dce21-3c8a-422f-9abc-c54bd8f260b9 req-509c720a-b65a-456b-95cf-7dd57556b19c service nova] Acquiring lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-546dce21-3c8a-422f-9abc-c54bd8f260b9 req-509c720a-b65a-456b-95cf-7dd57556b19c service nova] Acquired lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG nova.network.neutron [req-546dce21-3c8a-422f-9abc-c54bd8f260b9 req-509c720a-b65a-456b-95cf-7dd57556b19c service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Refreshing network info cache for port 33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "06086205-4963-4336-8652-e93842bc8a3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "06086205-4963-4336-8652-e93842bc8a3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "06086205-4963-4336-8652-e93842bc8a3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:30 user nova-compute[76442]: INFO nova.compute.manager [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Terminating instance
Nov 14 21:12:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:12:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-592b3cd4-63b2-4eca-9283-c482bf3a646a req-72d34ebe-6605-4bce-a031-2451174b1281 service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received event network-vif-unplugged-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-592b3cd4-63b2-4eca-9283-c482bf3a646a req-72d34ebe-6605-4bce-a031-2451174b1281 service nova] Acquiring lock "06086205-4963-4336-8652-e93842bc8a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-592b3cd4-63b2-4eca-9283-c482bf3a646a req-72d34ebe-6605-4bce-a031-2451174b1281 service nova] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-592b3cd4-63b2-4eca-9283-c482bf3a646a req-72d34ebe-6605-4bce-a031-2451174b1281 service nova] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-592b3cd4-63b2-4eca-9283-c482bf3a646a req-72d34ebe-6605-4bce-a031-2451174b1281 service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] No waiting events found dispatching network-vif-unplugged-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.compute.manager [req-592b3cd4-63b2-4eca-9283-c482bf3a646a req-72d34ebe-6605-4bce-a031-2451174b1281 service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received event network-vif-unplugged-33f7be7b-505a-4c3c-a763-68553d8af784 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-546dce21-3c8a-422f-9abc-c54bd8f260b9 req-509c720a-b65a-456b-95cf-7dd57556b19c service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updated VIF entry in instance network info cache for port 33f7be7b-505a-4c3c-a763-68553d8af784. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.network.neutron [req-546dce21-3c8a-422f-9abc-c54bd8f260b9 req-509c720a-b65a-456b-95cf-7dd57556b19c service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updating instance_info_cache with network_info: [{"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-546dce21-3c8a-422f-9abc-c54bd8f260b9 req-509c720a-b65a-456b-95cf-7dd57556b19c service nova] Releasing lock "refresh_cache-06086205-4963-4336-8652-e93842bc8a3b" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:12:31 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Instance destroyed successfully.
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.objects.instance [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lazy-loading 'resources' on Instance uuid 06086205-4963-4336-8652-e93842bc8a3b {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1802437464',display_name='tempest-TestVolumeBootPattern-server-1802437464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1802437464',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMqtgJcFo+NzjA+7zu6HEvMzvBBa7Tnf+vJ5z+1XXrfQbhOVQpKiDoQUweMd2Q4UWCll8fgk22nliL1Wnofn524UJjbOUqMcyJZsIShi3LXF6K6AvSqhcjKFsOqpiDXyA==',key_name='tempest-TestVolumeBootPattern-280068245',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:07:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcaf0b599d7c4224be5cab0f23b95157',ramdisk_id='',reservation_id='r-yg59g3j7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-792728264',owner_user_name='tempest-TestVolumeBootPattern-792728264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:07:58Z,user_data=None,user_id='85f2d3fa02ad4ccbb286f49b8e59563d',uuid=06086205-4963-4336-8652-e93842bc8a3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converting VIF {"id": "33f7be7b-505a-4c3c-a763-68553d8af784", "address": "fa:16:3e:07:bb:26", "network": {"id": "2511b102-811c-4d09-9779-5ea9f64752bb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1260774140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcaf0b599d7c4224be5cab0f23b95157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f7be7b-50", "ovs_interfaceid": "33f7be7b-505a-4c3c-a763-68553d8af784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:bb:26,bridge_name='br-int',has_traffic_filtering=True,id=33f7be7b-505a-4c3c-a763-68553d8af784,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f7be7b-50') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_vif [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:bb:26,bridge_name='br-int',has_traffic_filtering=True,id=33f7be7b-505a-4c3c-a763-68553d8af784,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f7be7b-50') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33f7be7b-50, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f98e6d9-66a9-49d0-927e-cdb0bf07a0c9) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:12:31 user nova-compute[76442]: INFO os_vif [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:bb:26,bridge_name='br-int',has_traffic_filtering=True,id=33f7be7b-505a-4c3c-a763-68553d8af784,network=Network(2511b102-811c-4d09-9779-5ea9f64752bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f7be7b-50')
Nov 14 21:12:31 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAoYMbnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:12:31 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c27a829-f88d-41e2-8adb-233733ab5653]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:12:31 user nova-compute[76442]: No targets found.
Nov 14 21:12:31 user nova-compute[76442]: iSNS:
Nov 14 21:12:31 user nova-compute[76442]: No targets found.
Nov 14 21:12:31 user nova-compute[76442]: STATIC:
Nov 14 21:12:31 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44
Nov 14 21:12:31 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:12:31 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:12:31 user nova-compute[76442]: FIRMWARE:
Nov 14 21:12:31 user nova-compute[76442]: No targets found.
Nov 14 21:12:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:12:31 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:12:31 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f62f1ec-4cad-4d25-91fd-c33c79b4e5c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[46593278-70f2-4b4c-88b1-b1cb9d28ed7d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:12:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 (non-flash)
Nov 14 21:12:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f070815a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b6e846-3c74-4404-9795-79f6c719edc2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b28f518-1ae6-424e-98ad-ca69989d83c8]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a304a8-35e3-4d14-b0b6-80ac02c65c78]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[124471f2-e329-409f-ad9f-941e8fed0777]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5ce8c8-e97b-4e3c-9cdb-5825f9c3989d]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[439f60e8-8d61-4533-9938-7378d8cba0dd]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260]
Nov 14 21:12:31 user nova-compute[76442]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44, portal: 172.16.0.220,3260] successful.
Nov 14 21:12:31 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:12:31 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22c817b9-dda6-48ed-855a-5bfe80431d44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2aa96-4b2f-4568-a8e2-a2af1134e964]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] <== disconnect_volume: return (299ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:12:32 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Deleting instance files /opt/stack/data/nova/instances/06086205-4963-4336-8652-e93842bc8a3b_del
Nov 14 21:12:32 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Deletion of /opt/stack/data/nova/instances/06086205-4963-4336-8652-e93842bc8a3b_del complete
Nov 14 21:12:32 user nova-compute[76442]: INFO nova.compute.manager [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 21:12:32 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 06086205-4963-4336-8652-e93842bc8a3b] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:32 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:12:32 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Took 0.41 seconds to deallocate network for instance.
Nov 14 21:12:32 user nova-compute[76442]: DEBUG nova.compute.manager [req-fbdfcc8c-43bb-4277-b57f-e166245cfef2 req-0f19ce80-a683-4dca-b4d2-4980fe48f3f0 service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received event network-vif-deleted-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:12:33 user nova-compute[76442]: INFO nova.compute.manager [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 21:12:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-2e5a3773-40a5-47cc-9ddd-fc718cd3f01d req-6b11f37f-8c34-4bbb-bdf0-9cc10ae0bffa service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received event network-vif-plugged-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:12:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2e5a3773-40a5-47cc-9ddd-fc718cd3f01d req-6b11f37f-8c34-4bbb-bdf0-9cc10ae0bffa service nova] Acquiring lock "06086205-4963-4336-8652-e93842bc8a3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2e5a3773-40a5-47cc-9ddd-fc718cd3f01d req-6b11f37f-8c34-4bbb-bdf0-9cc10ae0bffa service nova] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-2e5a3773-40a5-47cc-9ddd-fc718cd3f01d req-6b11f37f-8c34-4bbb-bdf0-9cc10ae0bffa service nova] Lock "06086205-4963-4336-8652-e93842bc8a3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:33 user nova-compute[76442]: DEBUG nova.compute.manager [req-2e5a3773-40a5-47cc-9ddd-fc718cd3f01d req-6b11f37f-8c34-4bbb-bdf0-9cc10ae0bffa service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] No waiting events found dispatching network-vif-plugged-33f7be7b-505a-4c3c-a763-68553d8af784 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:12:33 user nova-compute[76442]: WARNING nova.compute.manager [req-2e5a3773-40a5-47cc-9ddd-fc718cd3f01d req-6b11f37f-8c34-4bbb-bdf0-9cc10ae0bffa service nova] [instance: 06086205-4963-4336-8652-e93842bc8a3b] Received unexpected event network-vif-plugged-33f7be7b-505a-4c3c-a763-68553d8af784 for instance with vm_state deleted and task_state None.
Nov 14 21:12:33 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:12:33 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:12:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:33 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Deleted allocations for instance 06086205-4963-4336-8652-e93842bc8a3b
Nov 14 21:12:33 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-1324ee90-07f2-47e7-921d-162511c9f0ff tempest-TestVolumeBootPattern-792728264 tempest-TestVolumeBootPattern-792728264-project-member] Lock "06086205-4963-4336-8652-e93842bc8a3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.621s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:12:35 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:12:36 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:12:36 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:12:36 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=25.069000244140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 68cabd44-d0ff-49db-89e9-e6282a25a6fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:39 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:12:39 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:12:39 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:12:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:12:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:12:39 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:12:39 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:12:40 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [{"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:12:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-68cabd44-d0ff-49db-89e9-e6282a25a6fb" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:12:40 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:12:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:12:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:12:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:12:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:12:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:42 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:12:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:12:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:12:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:12:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:12:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:53 user nova-compute[76442]: INFO nova.compute.manager [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Terminating instance
Nov 14 21:12:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-1feb3792-4244-4d6c-b946-16f729207582 req-9761678f-a12a-4f4d-8b86-3c62573e016b service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-unplugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1feb3792-4244-4d6c-b946-16f729207582 req-9761678f-a12a-4f4d-8b86-3c62573e016b service nova] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1feb3792-4244-4d6c-b946-16f729207582 req-9761678f-a12a-4f4d-8b86-3c62573e016b service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1feb3792-4244-4d6c-b946-16f729207582 req-9761678f-a12a-4f4d-8b86-3c62573e016b service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-1feb3792-4244-4d6c-b946-16f729207582 req-9761678f-a12a-4f4d-8b86-3c62573e016b service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] No waiting events found dispatching network-vif-unplugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:12:53 user nova-compute[76442]: DEBUG nova.compute.manager [req-1feb3792-4244-4d6c-b946-16f729207582 req-9761678f-a12a-4f4d-8b86-3c62573e016b service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-unplugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:12:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Instance destroyed successfully.
Nov 14 21:12:54 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lazy-loading 'resources' on Instance uuid 68cabd44-d0ff-49db-89e9-e6282a25a6fb {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T21:07:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1288273930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1288273930',id=48,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+j4kvpalFxvR4qeYGA0ZBZD+ERFLswDkCwPZwJ5LzhDlvETYXxqUo94IqtD4jG/yC872nZzlEV/mk8Zaxa7a4MrCUSa8ZvOq4FdXTe8Vip50N9sWsiL4g7BJAimizMQA==',key_name='tempest-keypair-1958698388',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:11:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04176df08b194d959611acf480360493',ramdisk_id='',reservation_id='r-v27gb2ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1848978120',owner_user_name='tempest-AttachVolumeShelveTestJSON-1848978120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb9d2e0b8d7b4bdf94872e2186dfad31',uuid=68cabd44-d0ff-49db-89e9-e6282a25a6fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converting VIF {"id": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "address": "fa:16:3e:43:ed:6e", "network": {"id": "1cb7f625-28e5-46ec-b859-46fd4ca7c0c1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-991029951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04176df08b194d959611acf480360493", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ab2ff2-d8", "ovs_interfaceid": "00ab2ff2-d8cd-43ea-bde7-286df17ad6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG os_vif [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00ab2ff2-d8, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ccfcfb3-286e-4178-8d33-5917f186b722) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:12:54 user nova-compute[76442]: INFO os_vif [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:ed:6e,bridge_name='br-int',has_traffic_filtering=True,id=00ab2ff2-d8cd-43ea-bde7-286df17ad6d6,network=Network(1cb7f625-28e5-46ec-b859-46fd4ca7c0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ab2ff2-d8')
Nov 14 21:12:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Deleting instance files /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb_del
Nov 14 21:12:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Deletion of /opt/stack/data/nova/instances/68cabd44-d0ff-49db-89e9-e6282a25a6fb_del complete
Nov 14 21:12:54 user nova-compute[76442]: INFO nova.compute.manager [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 21:12:54 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:12:54 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Took 0.63 seconds to deallocate network for instance.
Nov 14 21:12:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:12:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:54 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Deleted allocations for instance 68cabd44-d0ff-49db-89e9-e6282a25a6fb
Nov 14 21:12:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7bedc4ff-7f3f-4dbd-89ee-d7c9619dc0fb tempest-AttachVolumeShelveTestJSON-1848978120 tempest-AttachVolumeShelveTestJSON-1848978120-project-member] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.820s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-d0bfd716-4ba6-4984-ac08-96aac677f0f8 req-96dd6e22-c687-4e76-a929-0e4e22794376 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:12:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d0bfd716-4ba6-4984-ac08-96aac677f0f8 req-96dd6e22-c687-4e76-a929-0e4e22794376 service nova] Acquiring lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:12:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d0bfd716-4ba6-4984-ac08-96aac677f0f8 req-96dd6e22-c687-4e76-a929-0e4e22794376 service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:12:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-d0bfd716-4ba6-4984-ac08-96aac677f0f8 req-96dd6e22-c687-4e76-a929-0e4e22794376 service nova] Lock "68cabd44-d0ff-49db-89e9-e6282a25a6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:12:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-d0bfd716-4ba6-4984-ac08-96aac677f0f8 req-96dd6e22-c687-4e76-a929-0e4e22794376 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] No waiting events found dispatching network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:12:55 user nova-compute[76442]: WARNING nova.compute.manager [req-d0bfd716-4ba6-4984-ac08-96aac677f0f8 req-96dd6e22-c687-4e76-a929-0e4e22794376 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received unexpected event network-vif-plugged-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 for instance with vm_state deleted and task_state None.
Nov 14 21:12:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-d0bfd716-4ba6-4984-ac08-96aac677f0f8 req-96dd6e22-c687-4e76-a929-0e4e22794376 service nova] [instance: 68cabd44-d0ff-49db-89e9-e6282a25a6fb] Received event network-vif-deleted-00ab2ff2-d8cd-43ea-bde7-286df17ad6d6 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:12:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:12:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:13:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:13:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:13:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:13:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:13:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:24 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:28 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:29 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:30 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:13:31 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:32 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:34 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:36 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:37 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:13:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:13:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:13:37 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:13:37 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:13:37 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:13:37 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9144MB free_disk=25.095252990722656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:13:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:13:37 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:13:37 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:13:37 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:13:38 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:13:38 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:13:38 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:13:38 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:13:39 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:13:40 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:40 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:13:40 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:13:40 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 21:13:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:13:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:49 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:13:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:13:59 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:09 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "8b71b118-329e-4ba5-aa90-cc6946c203ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:14:11 user nova-compute[76442]: INFO nova.compute.claims [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Claim successful on node user
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 21:14:11 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.policy [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e836ddb5cf7e4dad9b8a4b1e527f4d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83b28e7f1f443e89dfcf63d2b902940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:14:11 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Creating image(s)
Nov 14 21:14:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "/opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "/opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:14:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.182s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk 1073741824" returned: 0 in 0.056s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Successfully created port: 0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Cannot resize image /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Ensure instance console log exists: /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:14:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Successfully updated port: 0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquired lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-f5106210-d3da-49ee-ab0b-df59a1f742ec req-8f9a87df-f814-4d21-a2d3-7b56c3b8a716 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received event network-changed-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.compute.manager [req-f5106210-d3da-49ee-ab0b-df59a1f742ec req-8f9a87df-f814-4d21-a2d3-7b56c3b8a716 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Refreshing instance network info cache due to event network-changed-0180b8b0-a058-4810-b785-eb7865c7dfb4. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f5106210-d3da-49ee-ab0b-df59a1f742ec req-8f9a87df-f814-4d21-a2d3-7b56c3b8a716 service nova] Acquiring lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Updating instance_info_cache with network_info: [{"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Releasing lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Instance network_info: |[{"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f5106210-d3da-49ee-ab0b-df59a1f742ec req-8f9a87df-f814-4d21-a2d3-7b56c3b8a716 service nova] Acquired lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-f5106210-d3da-49ee-ab0b-df59a1f742ec req-8f9a87df-f814-4d21-a2d3-7b56c3b8a716 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Refreshing network info cache for port 0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Start _get_guest_xml network_info=[{"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:14:13 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:14:13 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-181003028',display_name='tempest-VolumesActionsTest-instance-181003028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-181003028',id=51,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d83b28e7f1f443e89dfcf63d2b902940',ramdisk_id='',reservation_id='r-ndkobhq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-682283000',owner_user_name='tempest-VolumesActionsTest-682283000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:14:12Z,user_data=None,user_id='e836ddb5cf7e4dad9b8a4b1e527f4d23',uuid=8b71b118-329e-4ba5-aa90-cc6946c203ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converting VIF {"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:22:df,bridge_name='br-int',has_traffic_filtering=True,id=0180b8b0-a058-4810-b785-eb7865c7dfb4,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0180b8b0-a0') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.objects.instance [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b71b118-329e-4ba5-aa90-cc6946c203ac {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:14:13 user nova-compute[76442]:   <uuid>8b71b118-329e-4ba5-aa90-cc6946c203ac</uuid>
Nov 14 21:14:13 user nova-compute[76442]:   <name>instance-00000033</name>
Nov 14 21:14:13 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:14:13 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:14:13 user nova-compute[76442]:   <metadata>
Nov 14 21:14:13 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:14:13 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:14:13 user nova-compute[76442]:       <nova:name>tempest-VolumesActionsTest-instance-181003028</nova:name>
Nov 14 21:14:13 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:14:13</nova:creationTime>
Nov 14 21:14:13 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:14:13 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:14:13 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:14:13 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:14:13 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:14:13 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:14:13 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:14:13 user nova-compute[76442]:       <nova:owner>
Nov 14 21:14:13 user nova-compute[76442]:         <nova:user uuid="e836ddb5cf7e4dad9b8a4b1e527f4d23">tempest-VolumesActionsTest-682283000-project-member</nova:user>
Nov 14 21:14:13 user nova-compute[76442]:         <nova:project uuid="d83b28e7f1f443e89dfcf63d2b902940">tempest-VolumesActionsTest-682283000</nova:project>
Nov 14 21:14:13 user nova-compute[76442]:       </nova:owner>
Nov 14 21:14:13 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 21:14:13 user nova-compute[76442]:       <nova:ports>
Nov 14 21:14:13 user nova-compute[76442]:         <nova:port uuid="0180b8b0-a058-4810-b785-eb7865c7dfb4">
Nov 14 21:14:13 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 21:14:13 user nova-compute[76442]:         </nova:port>
Nov 14 21:14:13 user nova-compute[76442]:       </nova:ports>
Nov 14 21:14:13 user nova-compute[76442]:     </nova:instance>
Nov 14 21:14:13 user nova-compute[76442]:   </metadata>
Nov 14 21:14:13 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:14:13 user nova-compute[76442]:     <system>
Nov 14 21:14:13 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:14:13 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:14:13 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:14:13 user nova-compute[76442]:       <entry name="serial">8b71b118-329e-4ba5-aa90-cc6946c203ac</entry>
Nov 14 21:14:13 user nova-compute[76442]:       <entry name="uuid">8b71b118-329e-4ba5-aa90-cc6946c203ac</entry>
Nov 14 21:14:13 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:14:13 user nova-compute[76442]:     </system>
Nov 14 21:14:13 user nova-compute[76442]:   </sysinfo>
Nov 14 21:14:13 user nova-compute[76442]:   <os>
Nov 14 21:14:13 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:14:13 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:14:13 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:14:13 user nova-compute[76442]:   </os>
Nov 14 21:14:13 user nova-compute[76442]:   <features>
Nov 14 21:14:13 user nova-compute[76442]:     <acpi/>
Nov 14 21:14:13 user nova-compute[76442]:     <apic/>
Nov 14 21:14:13 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:14:13 user nova-compute[76442]:   </features>
Nov 14 21:14:13 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:14:13 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:14:13 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:14:13 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:14:13 user nova-compute[76442]:   </clock>
Nov 14 21:14:13 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:14:13 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:14:13 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:14:13 user nova-compute[76442]:   </cpu>
Nov 14 21:14:13 user nova-compute[76442]:   <devices>
Nov 14 21:14:13 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 21:14:13 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 21:14:13 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk"/>
Nov 14 21:14:13 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:14:13 user nova-compute[76442]:     </disk>
Nov 14 21:14:13 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:14:13 user nova-compute[76442]:       <mac address="fa:16:3e:96:22:df"/>
Nov 14 21:14:13 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:14:13 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:14:13 user nova-compute[76442]:       <target dev="tap0180b8b0-a0"/>
Nov 14 21:14:13 user nova-compute[76442]:     </interface>
Nov 14 21:14:13 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:14:13 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/console.log" append="off"/>
Nov 14 21:14:13 user nova-compute[76442]:     </serial>
Nov 14 21:14:13 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:14:13 user nova-compute[76442]:     <video>
Nov 14 21:14:13 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:14:13 user nova-compute[76442]:     </video>
Nov 14 21:14:13 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:14:13 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:14:13 user nova-compute[76442]:     </rng>
Nov 14 21:14:13 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:14:13 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:14:13 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:14:13 user nova-compute[76442]:     </memballoon>
Nov 14 21:14:13 user nova-compute[76442]:   </devices>
Nov 14 21:14:13 user nova-compute[76442]: </domain>
Nov 14 21:14:13 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-181003028',display_name='tempest-VolumesActionsTest-instance-181003028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-181003028',id=51,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d83b28e7f1f443e89dfcf63d2b902940',ramdisk_id='',reservation_id='r-ndkobhq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-682283000',owner_user_name='tempest-VolumesActionsTest-682283000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:14:12Z,user_data=None,user_id='e836ddb5cf7e4dad9b8a4b1e527f4d23',uuid=8b71b118-329e-4ba5-aa90-cc6946c203ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converting VIF {"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:22:df,bridge_name='br-int',has_traffic_filtering=True,id=0180b8b0-a058-4810-b785-eb7865c7dfb4,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0180b8b0-a0') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG os_vif [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:22:df,bridge_name='br-int',has_traffic_filtering=True,id=0180b8b0-a058-4810-b785-eb7865c7dfb4,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0180b8b0-a0') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eff996c1-44b1-5ddb-b94f-49e831687f87', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0180b8b0-a0, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0180b8b0-a0, col_values=(('qos', UUID('b171b3ae-b0df-49da-a99d-14a659002825')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0180b8b0-a0, col_values=(('external_ids', {'iface-id': '0180b8b0-a058-4810-b785-eb7865c7dfb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:22:df', 'vm-uuid': '8b71b118-329e-4ba5-aa90-cc6946c203ac'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:13 user nova-compute[76442]: INFO os_vif [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:22:df,bridge_name='br-int',has_traffic_filtering=True,id=0180b8b0-a058-4810-b785-eb7865c7dfb4,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0180b8b0-a0')
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] No VIF found with MAC fa:16:3e:96:22:df, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-f5106210-d3da-49ee-ab0b-df59a1f742ec req-8f9a87df-f814-4d21-a2d3-7b56c3b8a716 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Updated VIF entry in instance network info cache for port 0180b8b0-a058-4810-b785-eb7865c7dfb4. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG nova.network.neutron [req-f5106210-d3da-49ee-ab0b-df59a1f742ec req-8f9a87df-f814-4d21-a2d3-7b56c3b8a716 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Updating instance_info_cache with network_info: [{"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:14:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-f5106210-d3da-49ee-ab0b-df59a1f742ec req-8f9a87df-f814-4d21-a2d3-7b56c3b8a716 service nova] Releasing lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:14:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:14 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-8cd6a853-6ce0-4bc7-85bd-93c49b16a99d req-19ec8fc8-1d7e-44e6-a370-3e272458361b service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received event network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:14:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8cd6a853-6ce0-4bc7-85bd-93c49b16a99d req-19ec8fc8-1d7e-44e6-a370-3e272458361b service nova] Acquiring lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:14:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8cd6a853-6ce0-4bc7-85bd-93c49b16a99d req-19ec8fc8-1d7e-44e6-a370-3e272458361b service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:14:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8cd6a853-6ce0-4bc7-85bd-93c49b16a99d req-19ec8fc8-1d7e-44e6-a370-3e272458361b service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:14:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-8cd6a853-6ce0-4bc7-85bd-93c49b16a99d req-19ec8fc8-1d7e-44e6-a370-3e272458361b service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] No waiting events found dispatching network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:14:15 user nova-compute[76442]: WARNING nova.compute.manager [req-8cd6a853-6ce0-4bc7-85bd-93c49b16a99d req-19ec8fc8-1d7e-44e6-a370-3e272458361b service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received unexpected event network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 for instance with vm_state building and task_state spawning.
Nov 14 21:14:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:14:16 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Instance spawned successfully.
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:14:16 user nova-compute[76442]: INFO nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 14 21:14:16 user nova-compute[76442]: DEBUG nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:14:17 user nova-compute[76442]: INFO nova.compute.manager [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Took 5.58 seconds to build instance.
Nov 14 21:14:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-92477600-2b6d-44d9-80e9-c3315b941436 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.684s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:14:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-a1f9ff2c-ffe0-4ee3-99ef-e6cc9013e00c req-f2a00ba9-29b5-4afc-8022-723337db7934 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received event network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:14:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a1f9ff2c-ffe0-4ee3-99ef-e6cc9013e00c req-f2a00ba9-29b5-4afc-8022-723337db7934 service nova] Acquiring lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:14:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a1f9ff2c-ffe0-4ee3-99ef-e6cc9013e00c req-f2a00ba9-29b5-4afc-8022-723337db7934 service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:14:17 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-a1f9ff2c-ffe0-4ee3-99ef-e6cc9013e00c req-f2a00ba9-29b5-4afc-8022-723337db7934 service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:14:17 user nova-compute[76442]: DEBUG nova.compute.manager [req-a1f9ff2c-ffe0-4ee3-99ef-e6cc9013e00c req-f2a00ba9-29b5-4afc-8022-723337db7934 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] No waiting events found dispatching network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:14:17 user nova-compute[76442]: WARNING nova.compute.manager [req-a1f9ff2c-ffe0-4ee3-99ef-e6cc9013e00c req-f2a00ba9-29b5-4afc-8022-723337db7934 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received unexpected event network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 for instance with vm_state active and task_state None.
Nov 14 21:14:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:30 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:14:31 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:14:31 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:14:31 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:14:32 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:14:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:34 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:14:37 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:14:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:39 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:14:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:14:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:14:39 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:14:39 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:14:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:14:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:14:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:14:39 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:14:40 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:14:40 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:14:40 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9075MB free_disk=25.05746841430664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:14:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:14:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:14:40 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 8b71b118-329e-4ba5-aa90-cc6946c203ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:14:40 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:14:40 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:14:40 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:14:40 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:14:40 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:14:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:14:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:14:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:14:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:14:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:14:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:14:41 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:14:41 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 8b71b118-329e-4ba5-aa90-cc6946c203ac {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:14:42 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Updating instance_info_cache with network_info: [{"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:14:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:14:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:14:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:45 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:14:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:14:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:15:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:15:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:15:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:15:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:15:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:15:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:15:31 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:15:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:33 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:15:34 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:36 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:15:38 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:39 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:40 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:40 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:15:40 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:15:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:15:40 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:15:40 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:15:40 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 8b71b118-329e-4ba5-aa90-cc6946c203ac {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Updating instance_info_cache with network_info: [{"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-8b71b118-329e-4ba5-aa90-cc6946c203ac" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:15:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:15:42 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:15:42 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:15:42 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9083MB free_disk=25.05547332763672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:15:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:15:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:15:42 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 8b71b118-329e-4ba5-aa90-cc6946c203ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:15:42 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:15:42 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:15:42 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:15:42 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:15:42 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:15:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:15:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:15:47 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:15:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:15:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:15:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "8b71b118-329e-4ba5-aa90-cc6946c203ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:02 user nova-compute[76442]: INFO nova.compute.manager [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Terminating instance
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.compute.manager [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-8d5ceb1c-2ec6-4623-a501-eb82ac52ea0a req-145d0bb7-7dd7-4877-8127-4cfd6c46a926 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received event network-vif-unplugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8d5ceb1c-2ec6-4623-a501-eb82ac52ea0a req-145d0bb7-7dd7-4877-8127-4cfd6c46a926 service nova] Acquiring lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8d5ceb1c-2ec6-4623-a501-eb82ac52ea0a req-145d0bb7-7dd7-4877-8127-4cfd6c46a926 service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-8d5ceb1c-2ec6-4623-a501-eb82ac52ea0a req-145d0bb7-7dd7-4877-8127-4cfd6c46a926 service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-8d5ceb1c-2ec6-4623-a501-eb82ac52ea0a req-145d0bb7-7dd7-4877-8127-4cfd6c46a926 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] No waiting events found dispatching network-vif-unplugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.compute.manager [req-8d5ceb1c-2ec6-4623-a501-eb82ac52ea0a req-145d0bb7-7dd7-4877-8127-4cfd6c46a926 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received event network-vif-unplugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Instance destroyed successfully.
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.objects.instance [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lazy-loading 'resources' on Instance uuid 8b71b118-329e-4ba5-aa90-cc6946c203ac {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:14:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-181003028',display_name='tempest-VolumesActionsTest-instance-181003028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-181003028',id=51,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d83b28e7f1f443e89dfcf63d2b902940',ramdisk_id='',reservation_id='r-ndkobhq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-682283000',owner_user_name='tempest-VolumesActionsTest-682283000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:14:17Z,user_data=None,user_id='e836ddb5cf7e4dad9b8a4b1e527f4d23',uuid=8b71b118-329e-4ba5-aa90-cc6946c203ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converting VIF {"id": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "address": "fa:16:3e:96:22:df", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0180b8b0-a0", "ovs_interfaceid": "0180b8b0-a058-4810-b785-eb7865c7dfb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:22:df,bridge_name='br-int',has_traffic_filtering=True,id=0180b8b0-a058-4810-b785-eb7865c7dfb4,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0180b8b0-a0') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG os_vif [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:22:df,bridge_name='br-int',has_traffic_filtering=True,id=0180b8b0-a058-4810-b785-eb7865c7dfb4,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0180b8b0-a0') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0180b8b0-a0, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b171b3ae-b0df-49da-a99d-14a659002825) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:02 user nova-compute[76442]: INFO os_vif [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:22:df,bridge_name='br-int',has_traffic_filtering=True,id=0180b8b0-a058-4810-b785-eb7865c7dfb4,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0180b8b0-a0')
Nov 14 21:16:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Deleting instance files /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac_del
Nov 14 21:16:02 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Deletion of /opt/stack/data/nova/instances/8b71b118-329e-4ba5-aa90-cc6946c203ac_del complete
Nov 14 21:16:02 user nova-compute[76442]: INFO nova.compute.manager [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 14 21:16:02 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:16:02 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:16:03 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Took 0.65 seconds to deallocate network for instance.
Nov 14 21:16:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:16:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:03 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Deleted allocations for instance 8b71b118-329e-4ba5-aa90-cc6946c203ac
Nov 14 21:16:03 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-832c778c-fc5c-44c0-b8d4-6f85234b8e84 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.647s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received event network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:16:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] Acquiring lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] No waiting events found dispatching network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:16:04 user nova-compute[76442]: WARNING nova.compute.manager [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received unexpected event network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 for instance with vm_state deleted and task_state None.
Nov 14 21:16:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received event network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:16:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] Acquiring lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] Lock "8b71b118-329e-4ba5-aa90-cc6946c203ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] No waiting events found dispatching network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:16:04 user nova-compute[76442]: WARNING nova.compute.manager [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received unexpected event network-vif-plugged-0180b8b0-a058-4810-b785-eb7865c7dfb4 for instance with vm_state deleted and task_state None.
Nov 14 21:16:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-6ed109be-be48-4024-81d3-200edfe92ad9 req-17774311-dde9-4001-905e-55d9438e2ac8 service nova] [instance: 8b71b118-329e-4ba5-aa90-cc6946c203ac] Received event network-vif-deleted-0180b8b0-a058-4810-b785-eb7865c7dfb4 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:16:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:16:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:16:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:16:12 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:16:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:16:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:16:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:27 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:32 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:33 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:16:34 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:37 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:38 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:39 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:41 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:16:41 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:16:41 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:16:41 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9181MB free_disk=25.082626342773438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:16:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:16:42 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:47 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:48 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:52 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "b33bb575-25e9-4ee2-974f-e32aa2159901" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 21:16:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:53 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:16:53 user nova-compute[76442]: INFO nova.compute.claims [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Claim successful on node user
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 21:16:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.policy [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e836ddb5cf7e4dad9b8a4b1e527f4d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83b28e7f1f443e89dfcf63d2b902940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:16:54 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Creating image(s)
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "/opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "/opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "/opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.171s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk 1073741824" returned: 0 in 0.063s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Successfully created port: d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 21:16:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Cannot resize image /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Ensure instance console log exists: /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Successfully updated port: d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "refresh_cache-b33bb575-25e9-4ee2-974f-e32aa2159901" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquired lock "refresh_cache-b33bb575-25e9-4ee2-974f-e32aa2159901" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-58cc9ed4-2714-417b-959c-ca293b55f158 req-ee691874-26ce-4100-b9b0-8e9d75155c6f service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received event network-changed-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG nova.compute.manager [req-58cc9ed4-2714-417b-959c-ca293b55f158 req-ee691874-26ce-4100-b9b0-8e9d75155c6f service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Refreshing instance network info cache due to event network-changed-d2597d9b-27bc-45d9-937e-85772a4163fa. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:16:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58cc9ed4-2714-417b-959c-ca293b55f158 req-ee691874-26ce-4100-b9b0-8e9d75155c6f service nova] Acquiring lock "refresh_cache-b33bb575-25e9-4ee2-974f-e32aa2159901" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.network.neutron [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Updating instance_info_cache with network_info: [{"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Releasing lock "refresh_cache-b33bb575-25e9-4ee2-974f-e32aa2159901" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Instance network_info: |[{"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58cc9ed4-2714-417b-959c-ca293b55f158 req-ee691874-26ce-4100-b9b0-8e9d75155c6f service nova] Acquired lock "refresh_cache-b33bb575-25e9-4ee2-974f-e32aa2159901" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-58cc9ed4-2714-417b-959c-ca293b55f158 req-ee691874-26ce-4100-b9b0-8e9d75155c6f service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Refreshing network info cache for port d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Start _get_guest_xml network_info=[{"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:16:56 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:16:56 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-411346262',display_name='tempest-VolumesActionsTest-instance-411346262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-411346262',id=52,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d83b28e7f1f443e89dfcf63d2b902940',ramdisk_id='',reservation_id='r-v5lbejso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-682283000',owner_user_name='tempest-VolumesActionsTest-682283000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:16:54Z,user_data=None,user_id='e836ddb5cf7e4dad9b8a4b1e527f4d23',uuid=b33bb575-25e9-4ee2-974f-e32aa2159901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converting VIF {"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:71:8f,bridge_name='br-int',has_traffic_filtering=True,id=d2597d9b-27bc-45d9-937e-85772a4163fa,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2597d9b-27') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.objects.instance [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lazy-loading 'pci_devices' on Instance uuid b33bb575-25e9-4ee2-974f-e32aa2159901 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:16:56 user nova-compute[76442]:   <uuid>b33bb575-25e9-4ee2-974f-e32aa2159901</uuid>
Nov 14 21:16:56 user nova-compute[76442]:   <name>instance-00000034</name>
Nov 14 21:16:56 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:16:56 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:16:56 user nova-compute[76442]:   <metadata>
Nov 14 21:16:56 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:16:56 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:16:56 user nova-compute[76442]:       <nova:name>tempest-VolumesActionsTest-instance-411346262</nova:name>
Nov 14 21:16:56 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:16:56</nova:creationTime>
Nov 14 21:16:56 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:16:56 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:16:56 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:16:56 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:16:56 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:16:56 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:16:56 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:16:56 user nova-compute[76442]:       <nova:owner>
Nov 14 21:16:56 user nova-compute[76442]:         <nova:user uuid="e836ddb5cf7e4dad9b8a4b1e527f4d23">tempest-VolumesActionsTest-682283000-project-member</nova:user>
Nov 14 21:16:56 user nova-compute[76442]:         <nova:project uuid="d83b28e7f1f443e89dfcf63d2b902940">tempest-VolumesActionsTest-682283000</nova:project>
Nov 14 21:16:56 user nova-compute[76442]:       </nova:owner>
Nov 14 21:16:56 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 21:16:56 user nova-compute[76442]:       <nova:ports>
Nov 14 21:16:56 user nova-compute[76442]:         <nova:port uuid="d2597d9b-27bc-45d9-937e-85772a4163fa">
Nov 14 21:16:56 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 21:16:56 user nova-compute[76442]:         </nova:port>
Nov 14 21:16:56 user nova-compute[76442]:       </nova:ports>
Nov 14 21:16:56 user nova-compute[76442]:     </nova:instance>
Nov 14 21:16:56 user nova-compute[76442]:   </metadata>
Nov 14 21:16:56 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:16:56 user nova-compute[76442]:     <system>
Nov 14 21:16:56 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:16:56 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:16:56 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:16:56 user nova-compute[76442]:       <entry name="serial">b33bb575-25e9-4ee2-974f-e32aa2159901</entry>
Nov 14 21:16:56 user nova-compute[76442]:       <entry name="uuid">b33bb575-25e9-4ee2-974f-e32aa2159901</entry>
Nov 14 21:16:56 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:16:56 user nova-compute[76442]:     </system>
Nov 14 21:16:56 user nova-compute[76442]:   </sysinfo>
Nov 14 21:16:56 user nova-compute[76442]:   <os>
Nov 14 21:16:56 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:16:56 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:16:56 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:16:56 user nova-compute[76442]:   </os>
Nov 14 21:16:56 user nova-compute[76442]:   <features>
Nov 14 21:16:56 user nova-compute[76442]:     <acpi/>
Nov 14 21:16:56 user nova-compute[76442]:     <apic/>
Nov 14 21:16:56 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:16:56 user nova-compute[76442]:   </features>
Nov 14 21:16:56 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:16:56 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:16:56 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:16:56 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:16:56 user nova-compute[76442]:   </clock>
Nov 14 21:16:56 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:16:56 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:16:56 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:16:56 user nova-compute[76442]:   </cpu>
Nov 14 21:16:56 user nova-compute[76442]:   <devices>
Nov 14 21:16:56 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 21:16:56 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 21:16:56 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk"/>
Nov 14 21:16:56 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:16:56 user nova-compute[76442]:     </disk>
Nov 14 21:16:56 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:16:56 user nova-compute[76442]:       <mac address="fa:16:3e:92:71:8f"/>
Nov 14 21:16:56 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:16:56 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:16:56 user nova-compute[76442]:       <target dev="tapd2597d9b-27"/>
Nov 14 21:16:56 user nova-compute[76442]:     </interface>
Nov 14 21:16:56 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:16:56 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/console.log" append="off"/>
Nov 14 21:16:56 user nova-compute[76442]:     </serial>
Nov 14 21:16:56 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:16:56 user nova-compute[76442]:     <video>
Nov 14 21:16:56 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:16:56 user nova-compute[76442]:     </video>
Nov 14 21:16:56 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:16:56 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:16:56 user nova-compute[76442]:     </rng>
Nov 14 21:16:56 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:16:56 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:16:56 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:16:56 user nova-compute[76442]:     </memballoon>
Nov 14 21:16:56 user nova-compute[76442]:   </devices>
Nov 14 21:16:56 user nova-compute[76442]: </domain>
Nov 14 21:16:56 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-411346262',display_name='tempest-VolumesActionsTest-instance-411346262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-411346262',id=52,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d83b28e7f1f443e89dfcf63d2b902940',ramdisk_id='',reservation_id='r-v5lbejso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-682283000',owner_user_name='tempest-VolumesActionsTest-682283000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:16:54Z,user_data=None,user_id='e836ddb5cf7e4dad9b8a4b1e527f4d23',uuid=b33bb575-25e9-4ee2-974f-e32aa2159901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converting VIF {"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:71:8f,bridge_name='br-int',has_traffic_filtering=True,id=d2597d9b-27bc-45d9-937e-85772a4163fa,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2597d9b-27') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG os_vif [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:71:8f,bridge_name='br-int',has_traffic_filtering=True,id=d2597d9b-27bc-45d9-937e-85772a4163fa,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2597d9b-27') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87ea9be4-e7f1-550e-be31-6f6b7582e4f2', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2597d9b-27, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2597d9b-27, col_values=(('qos', UUID('e6083ecd-318c-4a78-b238-5ca67028002a')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2597d9b-27, col_values=(('external_ids', {'iface-id': 'd2597d9b-27bc-45d9-937e-85772a4163fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:71:8f', 'vm-uuid': 'b33bb575-25e9-4ee2-974f-e32aa2159901'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:56 user nova-compute[76442]: INFO os_vif [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:71:8f,bridge_name='br-int',has_traffic_filtering=True,id=d2597d9b-27bc-45d9-937e-85772a4163fa,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2597d9b-27')
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] No VIF found with MAC fa:16:3e:92:71:8f, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-58cc9ed4-2714-417b-959c-ca293b55f158 req-ee691874-26ce-4100-b9b0-8e9d75155c6f service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Updated VIF entry in instance network info cache for port d2597d9b-27bc-45d9-937e-85772a4163fa. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG nova.network.neutron [req-58cc9ed4-2714-417b-959c-ca293b55f158 req-ee691874-26ce-4100-b9b0-8e9d75155c6f service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Updating instance_info_cache with network_info: [{"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:16:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-58cc9ed4-2714-417b-959c-ca293b55f158 req-ee691874-26ce-4100-b9b0-8e9d75155c6f service nova] Releasing lock "refresh_cache-b33bb575-25e9-4ee2-974f-e32aa2159901" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:16:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:57 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-7ff4d614-65f9-447c-95f7-dba9dad63597 req-fa205989-b1a6-427a-b71c-70961e5f453d service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received event network-vif-plugged-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:16:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7ff4d614-65f9-447c-95f7-dba9dad63597 req-fa205989-b1a6-427a-b71c-70961e5f453d service nova] Acquiring lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7ff4d614-65f9-447c-95f7-dba9dad63597 req-fa205989-b1a6-427a-b71c-70961e5f453d service nova] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7ff4d614-65f9-447c-95f7-dba9dad63597 req-fa205989-b1a6-427a-b71c-70961e5f453d service nova] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:57 user nova-compute[76442]: DEBUG nova.compute.manager [req-7ff4d614-65f9-447c-95f7-dba9dad63597 req-fa205989-b1a6-427a-b71c-70961e5f453d service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] No waiting events found dispatching network-vif-plugged-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:16:57 user nova-compute[76442]: WARNING nova.compute.manager [req-7ff4d614-65f9-447c-95f7-dba9dad63597 req-fa205989-b1a6-427a-b71c-70961e5f453d service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received unexpected event network-vif-plugged-d2597d9b-27bc-45d9-937e-85772a4163fa for instance with vm_state building and task_state spawning.
Nov 14 21:16:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:16:59 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Instance spawned successfully.
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:16:59 user nova-compute[76442]: INFO nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:16:59 user nova-compute[76442]: INFO nova.compute.manager [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Took 5.94 seconds to build instance.
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-7601480e-77c6-468a-92c7-98e3dc60b938 req-2e4635da-58c2-4f19-96bd-d4da6e0b6be6 service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received event network-vif-plugged-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7601480e-77c6-468a-92c7-98e3dc60b938 req-2e4635da-58c2-4f19-96bd-d4da6e0b6be6 service nova] Acquiring lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7601480e-77c6-468a-92c7-98e3dc60b938 req-2e4635da-58c2-4f19-96bd-d4da6e0b6be6 service nova] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-7601480e-77c6-468a-92c7-98e3dc60b938 req-2e4635da-58c2-4f19-96bd-d4da6e0b6be6 service nova] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:16:59 user nova-compute[76442]: DEBUG nova.compute.manager [req-7601480e-77c6-468a-92c7-98e3dc60b938 req-2e4635da-58c2-4f19-96bd-d4da6e0b6be6 service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] No waiting events found dispatching network-vif-plugged-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:16:59 user nova-compute[76442]: WARNING nova.compute.manager [req-7601480e-77c6-468a-92c7-98e3dc60b938 req-2e4635da-58c2-4f19-96bd-d4da6e0b6be6 service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received unexpected event network-vif-plugged-d2597d9b-27bc-45d9-937e-85772a4163fa for instance with vm_state active and task_state None.
Nov 14 21:16:59 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-4f440cf5-f0e6-416b-9112-301f2721be38 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.033s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:17:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:28 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:34 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:35 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:17:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:40 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:42 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:43 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:17:43 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:17:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-b33bb575-25e9-4ee2-974f-e32aa2159901" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:17:43 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-b33bb575-25e9-4ee2-974f-e32aa2159901" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:17:43 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:17:43 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid b33bb575-25e9-4ee2-974f-e32aa2159901 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Updating instance_info_cache with network_info: [{"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-b33bb575-25e9-4ee2-974f-e32aa2159901" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:17:44 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:17:44 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:17:44 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9091MB free_disk=25.05315399169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:17:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:17:45 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance b33bb575-25e9-4ee2-974f-e32aa2159901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:17:45 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:17:45 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:17:45 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:17:45 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:17:45 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:17:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:17:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:17:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:17:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:18:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:18:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:18:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:36 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:18:37 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:18:37 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:18:37 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:18:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:42 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:18:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Skipping network cache update for instance because it is being deleted. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "b33bb575-25e9-4ee2-974f-e32aa2159901" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:18:44 user nova-compute[76442]: INFO nova.compute.manager [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Terminating instance
Nov 14 21:18:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-36f5db46-06dd-4c38-be7a-5a9910718f91 req-1e7bceea-50f6-4594-b78c-99610f735596 service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received event network-vif-unplugged-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-36f5db46-06dd-4c38-be7a-5a9910718f91 req-1e7bceea-50f6-4594-b78c-99610f735596 service nova] Acquiring lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-36f5db46-06dd-4c38-be7a-5a9910718f91 req-1e7bceea-50f6-4594-b78c-99610f735596 service nova] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-36f5db46-06dd-4c38-be7a-5a9910718f91 req-1e7bceea-50f6-4594-b78c-99610f735596 service nova] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-36f5db46-06dd-4c38-be7a-5a9910718f91 req-1e7bceea-50f6-4594-b78c-99610f735596 service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] No waiting events found dispatching network-vif-unplugged-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:18:44 user nova-compute[76442]: DEBUG nova.compute.manager [req-36f5db46-06dd-4c38-be7a-5a9910718f91 req-1e7bceea-50f6-4594-b78c-99610f735596 service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received event network-vif-unplugged-d2597d9b-27bc-45d9-937e-85772a4163fa for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Instance destroyed successfully.
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.objects.instance [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lazy-loading 'resources' on Instance uuid b33bb575-25e9-4ee2-974f-e32aa2159901 {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-411346262',display_name='tempest-VolumesActionsTest-instance-411346262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-411346262',id=52,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d83b28e7f1f443e89dfcf63d2b902940',ramdisk_id='',reservation_id='r-v5lbejso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-682283000',owner_user_name='tempest-VolumesActionsTest-682283000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:17:00Z,user_data=None,user_id='e836ddb5cf7e4dad9b8a4b1e527f4d23',uuid=b33bb575-25e9-4ee2-974f-e32aa2159901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converting VIF {"id": "d2597d9b-27bc-45d9-937e-85772a4163fa", "address": "fa:16:3e:92:71:8f", "network": {"id": "0536e6ef-f3dc-4f6d-a9cc-aec173857b47", "bridge": "br-int", "label": "tempest-VolumesActionsTest-438850547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d83b28e7f1f443e89dfcf63d2b902940", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2597d9b-27", "ovs_interfaceid": "d2597d9b-27bc-45d9-937e-85772a4163fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:71:8f,bridge_name='br-int',has_traffic_filtering=True,id=d2597d9b-27bc-45d9-937e-85772a4163fa,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2597d9b-27') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG os_vif [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:71:8f,bridge_name='br-int',has_traffic_filtering=True,id=d2597d9b-27bc-45d9-937e-85772a4163fa,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2597d9b-27') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2597d9b-27, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6083ecd-318c-4a78-b238-5ca67028002a) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:18:45 user nova-compute[76442]: INFO os_vif [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:71:8f,bridge_name='br-int',has_traffic_filtering=True,id=d2597d9b-27bc-45d9-937e-85772a4163fa,network=Network(0536e6ef-f3dc-4f6d-a9cc-aec173857b47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2597d9b-27')
Nov 14 21:18:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Deleting instance files /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901_del
Nov 14 21:18:45 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Deletion of /opt/stack/data/nova/instances/b33bb575-25e9-4ee2-974f-e32aa2159901_del complete
Nov 14 21:18:45 user nova-compute[76442]: INFO nova.compute.manager [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 14 21:18:45 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-cfb4d9ef-6b00-4fd6-899e-bd47a7eb3509 req-adf01786-6e46-4969-8acf-6f91364a0c7c service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received event network-vif-deleted-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:18:45 user nova-compute[76442]: INFO nova.compute.manager [req-cfb4d9ef-6b00-4fd6-899e-bd47a7eb3509 req-adf01786-6e46-4969-8acf-6f91364a0c7c service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Neutron deleted interface d2597d9b-27bc-45d9-937e-85772a4163fa; detaching it from the instance and deleting it from the info cache
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.network.neutron [req-cfb4d9ef-6b00-4fd6-899e-bd47a7eb3509 req-adf01786-6e46-4969-8acf-6f91364a0c7c service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:18:45 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:18:45 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9202MB free_disk=25.08039093017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.compute.manager [req-cfb4d9ef-6b00-4fd6-899e-bd47a7eb3509 req-adf01786-6e46-4969-8acf-6f91364a0c7c service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Detach interface failed, port_id=d2597d9b-27bc-45d9-937e-85772a4163fa, reason: Instance b33bb575-25e9-4ee2-974f-e32aa2159901 could not be found. {{(pid=76442) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 21:18:45 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Took 0.68 seconds to deallocate network for instance.
Nov 14 21:18:45 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance b33bb575-25e9-4ee2-974f-e32aa2159901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:18:45 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.117s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:18:46 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Deleted allocations for instance b33bb575-25e9-4ee2-974f-e32aa2159901
Nov 14 21:18:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-f32ae89c-3f31-4dc7-ab4c-641ffcb98803 tempest-VolumesActionsTest-682283000 tempest-VolumesActionsTest-682283000-project-member] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.793s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-5ee94956-e713-405a-9fec-c6060de6979a req-c40f8bed-ec79-4fc8-a243-3507346f648e service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received event network-vif-plugged-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5ee94956-e713-405a-9fec-c6060de6979a req-c40f8bed-ec79-4fc8-a243-3507346f648e service nova] Acquiring lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5ee94956-e713-405a-9fec-c6060de6979a req-c40f8bed-ec79-4fc8-a243-3507346f648e service nova] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-5ee94956-e713-405a-9fec-c6060de6979a req-c40f8bed-ec79-4fc8-a243-3507346f648e service nova] Lock "b33bb575-25e9-4ee2-974f-e32aa2159901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:18:46 user nova-compute[76442]: DEBUG nova.compute.manager [req-5ee94956-e713-405a-9fec-c6060de6979a req-c40f8bed-ec79-4fc8-a243-3507346f648e service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] No waiting events found dispatching network-vif-plugged-d2597d9b-27bc-45d9-937e-85772a4163fa {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:18:46 user nova-compute[76442]: WARNING nova.compute.manager [req-5ee94956-e713-405a-9fec-c6060de6979a req-c40f8bed-ec79-4fc8-a243-3507346f648e service nova] [instance: b33bb575-25e9-4ee2-974f-e32aa2159901] Received unexpected event network-vif-plugged-d2597d9b-27bc-45d9-937e-85772a4163fa for instance with vm_state deleted and task_state None.
Nov 14 21:18:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:18:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:18:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:19:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:19:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:19:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:19:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:19:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:19:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:19:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:19:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:19:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:19:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:19:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:19:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:19:33 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:19:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:19:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:19:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:19:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:19:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:19:38 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:38 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:39 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:39 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:19:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:19:44 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:44 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:19:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:19:44 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 21:19:44 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:44 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:19:47 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:19:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:19:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:19:47 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:19:47 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:19:47 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:19:47 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9193MB free_disk=24.782886505126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:19:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:19:47 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:19:48 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:19:48 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:19:48 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:19:48 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:19:48 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:19:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:19:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:19:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:19:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:20:04 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:20:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:20:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:20:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:20:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:20:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:20:35 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:20:38 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:20:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:40 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:20:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:20:41 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:20:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:45 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:20:46 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:20:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:20:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:20:46 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 21:20:46 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:20:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:20:49 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:20:49 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9237MB free_disk=25.08121109008789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:20:49 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:20:50 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:20:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:20:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:20:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:20:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:20:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:20:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:54 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:20:54 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:20:58 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:03 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:07 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:12 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Starting instance... {{(pid=76442) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 21:21:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:12 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76442) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 21:21:12 user nova-compute[76442]: INFO nova.compute.claims [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Claim successful on node user
Nov 14 21:21:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Start building networks asynchronously for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Allocating IP information in the background. {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] allocate_for_instance() {{(pid=76442) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 21:21:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 21:21:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Start building block device mappings for instance. {{(pid=76442) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Start spawning the instance on the hypervisor. {{(pid=76442) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Creating instance directory {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 21:21:13 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Creating image(s)
Nov 14 21:21:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "/opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "/opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG nova.policy [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc7ffc8fcab14f7a95ef9204a33597d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919404873de4759b5a59388e5578338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76442) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.212s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.195s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk 1073741824 {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6,backing_fmt=raw /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk 1073741824" returned: 0 in 0.049s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "f74a87fd84c81bebb200085bd6dc630ade3fb9f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74a87fd84c81bebb200085bd6dc630ade3fb9f6 --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk. size=1073741824 {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Successfully created port: d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG nova.virt.disk.api [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Cannot resize image /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk to a smaller size. {{(pid=76442) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Created local disks {{(pid=76442) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Ensure instance console log exists: /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/console.log {{(pid=76442) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:14 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Successfully updated port: d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquired lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Building network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-1017eaa5-d4da-46f2-bf33-d1e350ccbe70 req-aeb8e23d-8630-420f-abd1-61207d1278b1 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received event network-changed-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.compute.manager [req-1017eaa5-d4da-46f2-bf33-d1e350ccbe70 req-aeb8e23d-8630-420f-abd1-61207d1278b1 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Refreshing instance network info cache due to event network-changed-d0617e22-dc6d-4fa1-bd04-c4bcdb670660. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1017eaa5-d4da-46f2-bf33-d1e350ccbe70 req-aeb8e23d-8630-420f-abd1-61207d1278b1 service nova] Acquiring lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Instance cache missing network info. {{(pid=76442) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.neutron [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Releasing lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Instance network_info: |[{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76442) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1017eaa5-d4da-46f2-bf33-d1e350ccbe70 req-aeb8e23d-8630-420f-abd1-61207d1278b1 service nova] Acquired lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-1017eaa5-d4da-46f2-bf33-d1e350ccbe70 req-aeb8e23d-8630-420f-abd1-61207d1278b1 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Refreshing network info cache for port d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Start _get_guest_xml network_info=[{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'guest_format': None, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c456f24a-ee5e-4551-88d7-a8348db880df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 21:21:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:21:15 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] CPU controller missing on host. {{(pid=76442) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.host [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] CPU controller found on host. {{(pid=76442) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76442) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T20:31:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T20:31:19Z,direct_url=<?>,disk_format='qcow2',id=c456f24a-ee5e-4551-88d7-a8348db880df,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e57cfad766224722a83729fdae4800c3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T20:31:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Flavor limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Image limits 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Flavor pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Image pref 0:0:0 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76442) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Got 1 possible topologies {{(pid=76442) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.hardware [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76442) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-714984422',display_name='tempest-SnapshotDataIntegrityTests-server-714984422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-714984422',id=53,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYNb1m1OfMGb2MzJztYli5sI6YqXObmj+e5zZE+tDXx/HZxU3oIvcnai15E635MaxaBeFJPPTjfIkJj0Gllv9I7b8ycRHu430bZrI5SqBDytgkbh7cDX34wphuagLAslw==',key_name='tempest-keypair-2050069723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a919404873de4759b5a59388e5578338',ramdisk_id='',reservation_id='r-akfiyspl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1262047182',owner_user_name='tempest-SnapshotDataIntegrityTests-1262047182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc7ffc8fcab14f7a95ef9204a33597d3',uuid=6b26074c-28bb-4c90-a225-01027f0831bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76442) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Converting VIF {"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b5:41,bridge_name='br-int',has_traffic_filtering=True,id=d0617e22-dc6d-4fa1-bd04-c4bcdb670660,network=Network(b7b97d43-8bf3-45a7-b12c-cd89a08ed767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0617e22-dc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.objects.instance [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 21:21:15 user nova-compute[76442]:   <uuid>6b26074c-28bb-4c90-a225-01027f0831bc</uuid>
Nov 14 21:21:15 user nova-compute[76442]:   <name>instance-00000035</name>
Nov 14 21:21:15 user nova-compute[76442]:   <memory>524288</memory>
Nov 14 21:21:15 user nova-compute[76442]:   <vcpu>1</vcpu>
Nov 14 21:21:15 user nova-compute[76442]:   <metadata>
Nov 14 21:21:15 user nova-compute[76442]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 21:21:15 user nova-compute[76442]:       <nova:package version="0.0.0"/>
Nov 14 21:21:15 user nova-compute[76442]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-714984422</nova:name>
Nov 14 21:21:15 user nova-compute[76442]:       <nova:creationTime>2023-11-14 21:21:15</nova:creationTime>
Nov 14 21:21:15 user nova-compute[76442]:       <nova:flavor name="m1.tiny">
Nov 14 21:21:15 user nova-compute[76442]:         <nova:memory>512</nova:memory>
Nov 14 21:21:15 user nova-compute[76442]:         <nova:disk>1</nova:disk>
Nov 14 21:21:15 user nova-compute[76442]:         <nova:swap>0</nova:swap>
Nov 14 21:21:15 user nova-compute[76442]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 21:21:15 user nova-compute[76442]:         <nova:vcpus>1</nova:vcpus>
Nov 14 21:21:15 user nova-compute[76442]:       </nova:flavor>
Nov 14 21:21:15 user nova-compute[76442]:       <nova:owner>
Nov 14 21:21:15 user nova-compute[76442]:         <nova:user uuid="bc7ffc8fcab14f7a95ef9204a33597d3">tempest-SnapshotDataIntegrityTests-1262047182-project-member</nova:user>
Nov 14 21:21:15 user nova-compute[76442]:         <nova:project uuid="a919404873de4759b5a59388e5578338">tempest-SnapshotDataIntegrityTests-1262047182</nova:project>
Nov 14 21:21:15 user nova-compute[76442]:       </nova:owner>
Nov 14 21:21:15 user nova-compute[76442]:       <nova:root type="image" uuid="c456f24a-ee5e-4551-88d7-a8348db880df"/>
Nov 14 21:21:15 user nova-compute[76442]:       <nova:ports>
Nov 14 21:21:15 user nova-compute[76442]:         <nova:port uuid="d0617e22-dc6d-4fa1-bd04-c4bcdb670660">
Nov 14 21:21:15 user nova-compute[76442]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 21:21:15 user nova-compute[76442]:         </nova:port>
Nov 14 21:21:15 user nova-compute[76442]:       </nova:ports>
Nov 14 21:21:15 user nova-compute[76442]:     </nova:instance>
Nov 14 21:21:15 user nova-compute[76442]:   </metadata>
Nov 14 21:21:15 user nova-compute[76442]:   <sysinfo type="smbios">
Nov 14 21:21:15 user nova-compute[76442]:     <system>
Nov 14 21:21:15 user nova-compute[76442]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 21:21:15 user nova-compute[76442]:       <entry name="product">OpenStack Nova</entry>
Nov 14 21:21:15 user nova-compute[76442]:       <entry name="version">0.0.0</entry>
Nov 14 21:21:15 user nova-compute[76442]:       <entry name="serial">6b26074c-28bb-4c90-a225-01027f0831bc</entry>
Nov 14 21:21:15 user nova-compute[76442]:       <entry name="uuid">6b26074c-28bb-4c90-a225-01027f0831bc</entry>
Nov 14 21:21:15 user nova-compute[76442]:       <entry name="family">Virtual Machine</entry>
Nov 14 21:21:15 user nova-compute[76442]:     </system>
Nov 14 21:21:15 user nova-compute[76442]:   </sysinfo>
Nov 14 21:21:15 user nova-compute[76442]:   <os>
Nov 14 21:21:15 user nova-compute[76442]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 21:21:15 user nova-compute[76442]:     <boot dev="hd"/>
Nov 14 21:21:15 user nova-compute[76442]:     <smbios mode="sysinfo"/>
Nov 14 21:21:15 user nova-compute[76442]:   </os>
Nov 14 21:21:15 user nova-compute[76442]:   <features>
Nov 14 21:21:15 user nova-compute[76442]:     <acpi/>
Nov 14 21:21:15 user nova-compute[76442]:     <apic/>
Nov 14 21:21:15 user nova-compute[76442]:     <vmcoreinfo/>
Nov 14 21:21:15 user nova-compute[76442]:   </features>
Nov 14 21:21:15 user nova-compute[76442]:   <clock offset="utc">
Nov 14 21:21:15 user nova-compute[76442]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 21:21:15 user nova-compute[76442]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 21:21:15 user nova-compute[76442]:     <timer name="hpet" present="no"/>
Nov 14 21:21:15 user nova-compute[76442]:   </clock>
Nov 14 21:21:15 user nova-compute[76442]:   <cpu mode="custom" match="exact">
Nov 14 21:21:15 user nova-compute[76442]:     <model>Nehalem</model>
Nov 14 21:21:15 user nova-compute[76442]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 21:21:15 user nova-compute[76442]:   </cpu>
Nov 14 21:21:15 user nova-compute[76442]:   <devices>
Nov 14 21:21:15 user nova-compute[76442]:     <disk type="file" device="disk">
Nov 14 21:21:15 user nova-compute[76442]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 21:21:15 user nova-compute[76442]:       <source file="/opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk"/>
Nov 14 21:21:15 user nova-compute[76442]:       <target dev="vda" bus="virtio"/>
Nov 14 21:21:15 user nova-compute[76442]:     </disk>
Nov 14 21:21:15 user nova-compute[76442]:     <interface type="ethernet">
Nov 14 21:21:15 user nova-compute[76442]:       <mac address="fa:16:3e:56:b5:41"/>
Nov 14 21:21:15 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:21:15 user nova-compute[76442]:       <mtu size="1442"/>
Nov 14 21:21:15 user nova-compute[76442]:       <target dev="tapd0617e22-dc"/>
Nov 14 21:21:15 user nova-compute[76442]:     </interface>
Nov 14 21:21:15 user nova-compute[76442]:     <serial type="pty">
Nov 14 21:21:15 user nova-compute[76442]:       <log file="/opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/console.log" append="off"/>
Nov 14 21:21:15 user nova-compute[76442]:     </serial>
Nov 14 21:21:15 user nova-compute[76442]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 21:21:15 user nova-compute[76442]:     <video>
Nov 14 21:21:15 user nova-compute[76442]:       <model type="virtio"/>
Nov 14 21:21:15 user nova-compute[76442]:     </video>
Nov 14 21:21:15 user nova-compute[76442]:     <rng model="virtio">
Nov 14 21:21:15 user nova-compute[76442]:       <backend model="random">/dev/urandom</backend>
Nov 14 21:21:15 user nova-compute[76442]:     </rng>
Nov 14 21:21:15 user nova-compute[76442]:     <controller type="usb" index="0" model="none"/>
Nov 14 21:21:15 user nova-compute[76442]:     <memballoon model="virtio">
Nov 14 21:21:15 user nova-compute[76442]:       <stats period="10"/>
Nov 14 21:21:15 user nova-compute[76442]:     </memballoon>
Nov 14 21:21:15 user nova-compute[76442]:   </devices>
Nov 14 21:21:15 user nova-compute[76442]: </domain>
Nov 14 21:21:15 user nova-compute[76442]:  {{(pid=76442) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-714984422',display_name='tempest-SnapshotDataIntegrityTests-server-714984422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-714984422',id=53,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYNb1m1OfMGb2MzJztYli5sI6YqXObmj+e5zZE+tDXx/HZxU3oIvcnai15E635MaxaBeFJPPTjfIkJj0Gllv9I7b8ycRHu430bZrI5SqBDytgkbh7cDX34wphuagLAslw==',key_name='tempest-keypair-2050069723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a919404873de4759b5a59388e5578338',ramdisk_id='',reservation_id='r-akfiyspl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1262047182',owner_user_name='tempest-SnapshotDataIntegrityTests-1262047182-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T21:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc7ffc8fcab14f7a95ef9204a33597d3',uuid=6b26074c-28bb-4c90-a225-01027f0831bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Converting VIF {"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:b5:41,bridge_name='br-int',has_traffic_filtering=True,id=d0617e22-dc6d-4fa1-bd04-c4bcdb670660,network=Network(b7b97d43-8bf3-45a7-b12c-cd89a08ed767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0617e22-dc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG os_vif [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b5:41,bridge_name='br-int',has_traffic_filtering=True,id=d0617e22-dc6d-4fa1-bd04-c4bcdb670660,network=Network(b7b97d43-8bf3-45a7-b12c-cd89a08ed767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0617e22-dc') {{(pid=76442) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a818666c-8ef1-57ba-acb7-638ce3a21d49', '_type': 'linux-noop'}}, row=False) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0617e22-dc, may_exist=True, interface_attrs={}) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0617e22-dc, col_values=(('qos', UUID('53cb70d0-604b-4e0a-b480-dd1dcc94d191')),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0617e22-dc, col_values=(('external_ids', {'iface-id': 'd0617e22-dc6d-4fa1-bd04-c4bcdb670660', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:b5:41', 'vm-uuid': '6b26074c-28bb-4c90-a225-01027f0831bc'}),), if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:15 user nova-compute[76442]: INFO os_vif [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:b5:41,bridge_name='br-int',has_traffic_filtering=True,id=d0617e22-dc6d-4fa1-bd04-c4bcdb670660,network=Network(b7b97d43-8bf3-45a7-b12c-cd89a08ed767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0617e22-dc')
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No VIF found with MAC fa:16:3e:56:b5:41, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-1017eaa5-d4da-46f2-bf33-d1e350ccbe70 req-aeb8e23d-8630-420f-abd1-61207d1278b1 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updated VIF entry in instance network info cache for port d0617e22-dc6d-4fa1-bd04-c4bcdb670660. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG nova.network.neutron [req-1017eaa5-d4da-46f2-bf33-d1e350ccbe70 req-aeb8e23d-8630-420f-abd1-61207d1278b1 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:21:15 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-1017eaa5-d4da-46f2-bf33-d1e350ccbe70 req-aeb8e23d-8630-420f-abd1-61207d1278b1 service nova] Releasing lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:21:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:17 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-bda1d612-dec3-4be8-b61d-7a90ec358f91 req-a58ccefc-1d30-4875-9fec-9d12d9a707a5 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received event network-vif-plugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:21:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bda1d612-dec3-4be8-b61d-7a90ec358f91 req-a58ccefc-1d30-4875-9fec-9d12d9a707a5 service nova] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bda1d612-dec3-4be8-b61d-7a90ec358f91 req-a58ccefc-1d30-4875-9fec-9d12d9a707a5 service nova] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-bda1d612-dec3-4be8-b61d-7a90ec358f91 req-a58ccefc-1d30-4875-9fec-9d12d9a707a5 service nova] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:18 user nova-compute[76442]: DEBUG nova.compute.manager [req-bda1d612-dec3-4be8-b61d-7a90ec358f91 req-a58ccefc-1d30-4875-9fec-9d12d9a707a5 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] No waiting events found dispatching network-vif-plugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:21:18 user nova-compute[76442]: WARNING nova.compute.manager [req-bda1d612-dec3-4be8-b61d-7a90ec358f91 req-a58ccefc-1d30-4875-9fec-9d12d9a707a5 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received unexpected event network-vif-plugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 for instance with vm_state building and task_state spawning.
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Instance event wait completed in 0 seconds for  {{(pid=76442) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Guest created on hypervisor {{(pid=76442) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 21:21:19 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Instance spawned successfully.
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Found default for hw_cdrom_bus of ide {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Found default for hw_disk_bus of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Found default for hw_input_bus of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Found default for hw_pointer_model of None {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Found default for hw_video_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Found default for hw_vif_model of virtio {{(pid=76442) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 21:21:19 user nova-compute[76442]: INFO nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 14 21:21:19 user nova-compute[76442]: DEBUG nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Checking state {{(pid=76442) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 21:21:19 user nova-compute[76442]: INFO nova.compute.manager [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Took 6.84 seconds to build instance.
Nov 14 21:21:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-bf16e918-03aa-4457-b12c-cf62f73da874 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.943s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-160db2e1-f234-45bc-b1da-b8f0536f8252 req-995f8d04-9cea-45b4-a30f-b9d3695ec871 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received event network-vif-plugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:21:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-160db2e1-f234-45bc-b1da-b8f0536f8252 req-995f8d04-9cea-45b4-a30f-b9d3695ec871 service nova] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-160db2e1-f234-45bc-b1da-b8f0536f8252 req-995f8d04-9cea-45b4-a30f-b9d3695ec871 service nova] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-160db2e1-f234-45bc-b1da-b8f0536f8252 req-995f8d04-9cea-45b4-a30f-b9d3695ec871 service nova] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:20 user nova-compute[76442]: DEBUG nova.compute.manager [req-160db2e1-f234-45bc-b1da-b8f0536f8252 req-995f8d04-9cea-45b4-a30f-b9d3695ec871 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] No waiting events found dispatching network-vif-plugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:21:20 user nova-compute[76442]: WARNING nova.compute.manager [req-160db2e1-f234-45bc-b1da-b8f0536f8252 req-995f8d04-9cea-45b4-a30f-b9d3695ec871 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received unexpected event network-vif-plugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 for instance with vm_state active and task_state None.
Nov 14 21:21:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:21:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:21:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:21:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:21:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:33 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:37 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:39 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:40 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:43 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:43 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:21:45 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:45 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:46 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:47 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 21:21:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 21:21:48 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:48 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:21:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:21:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:21:48 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:21:48 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:21:48 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:21:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:21:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:21:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:21:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:51 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:21:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:21:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:21:51 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:21:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:21:52 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=25.033340454101562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 6b26074c-28bb-4c90-a225-01027f0831bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:21:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:53 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:21:55 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_power_states {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Triggering sync for uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 21:21:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:21:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:21:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:21:55 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:21:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:22:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:22:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:09 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:22:09 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 21:22:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:22:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:22:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:22:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:37 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:22:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:22:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:22:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:22:45 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:22:45 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:22:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:22:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:22:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:47 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:22:48 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:22:49 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:22:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:22:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:22:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:22:49 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:22:49 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:22:49 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:22:50 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:22:50 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:22:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:22:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:22:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:22:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:22:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:22:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:22:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:22:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:22:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:22:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:22:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:22:53 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:22:53 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:22:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9076MB free_disk=25.03270721435547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:22:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:22:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:22:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 6b26074c-28bb-4c90-a225-01027f0831bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:22:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:22:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:22:53 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:22:53 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:22:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:22:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:22:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:22:57 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:23:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:23:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:23:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:23:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-484f9075-1e51-435a-9a70-ef5ac04dba69 req-ab9c08da-b440-4c6b-ad41-8bfe3b47f162 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received event network-changed-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:23:04 user nova-compute[76442]: DEBUG nova.compute.manager [req-484f9075-1e51-435a-9a70-ef5ac04dba69 req-ab9c08da-b440-4c6b-ad41-8bfe3b47f162 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Refreshing instance network info cache due to event network-changed-d0617e22-dc6d-4fa1-bd04-c4bcdb670660. {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 21:23:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-484f9075-1e51-435a-9a70-ef5ac04dba69 req-ab9c08da-b440-4c6b-ad41-8bfe3b47f162 service nova] Acquiring lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:23:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-484f9075-1e51-435a-9a70-ef5ac04dba69 req-ab9c08da-b440-4c6b-ad41-8bfe3b47f162 service nova] Acquired lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:23:04 user nova-compute[76442]: DEBUG nova.network.neutron [req-484f9075-1e51-435a-9a70-ef5ac04dba69 req-ab9c08da-b440-4c6b-ad41-8bfe3b47f162 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Refreshing network info cache for port d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 21:23:04 user nova-compute[76442]: DEBUG nova.network.neutron [req-484f9075-1e51-435a-9a70-ef5ac04dba69 req-ab9c08da-b440-4c6b-ad41-8bfe3b47f162 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updated VIF entry in instance network info cache for port d0617e22-dc6d-4fa1-bd04-c4bcdb670660. {{(pid=76442) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 21:23:04 user nova-compute[76442]: DEBUG nova.network.neutron [req-484f9075-1e51-435a-9a70-ef5ac04dba69 req-ab9c08da-b440-4c6b-ad41-8bfe3b47f162 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:23:04 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-484f9075-1e51-435a-9a70-ef5ac04dba69 req-ab9c08da-b440-4c6b-ad41-8bfe3b47f162 service nova] Releasing lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:23:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG nova.objects.instance [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:23:06 user nova-compute[76442]: INFO nova.compute.manager [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attaching volume cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d to /dev/vdb
Nov 14 21:23:06 user nova-compute[76442]: DEBUG os_brick.utils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[730c16cb-ab13-471b-9310-e0b5a9a9883c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cdcfc3-a175-4f35-9d3d-8cb986907070]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb8c21e-3ac9-4ee7-bfd5-874645464b9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9785ba-4f19-4320-a04c-fda7c43a78b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:23:06 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:23:06 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4fbed4-5050-477a-b8a5-1f0e71a6c585]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:23:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:23:07 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:23:07 user nova-compute[76442]: DEBUG os_brick.utils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:23:07 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating existing volume attachment record: 2821703f-9af4-4afb-83a5-6445e5d5a31f {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:23:08 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVgLcOTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:23:11 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:23:11 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:23:11 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adf9b6d-dafc-4e13-b2bd-ef641f18b211]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:23:11 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d854f00-6cf9-4069-85db-86b9eb4f5894]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d] added
Nov 14 21:23:11 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacbf4aa-a218-4cc1-8c7d-ade5b4619b92]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d735d4-02bc-4adb-99fe-4c6c2871179a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVgLcOTR {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVgLcOTR" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8b88ea-b2f5-4828-903f-f5735ac4e7d3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVgLcOTR'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff19913-7b9d-498c-9cfd-a0a86f932237]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dcce4a-5795-4450-b20e-9c98e5b6b5e9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:23:11 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:23:11 user nova-compute[76442]:  {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:23:11 user nova-compute[76442]: WARNING os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 21:23:11 user nova-compute[76442]: 
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[2958164d-cc0a-4bdb-b679-c6d4bd9dc521]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d, portal: 172.16.0.220,3260]
Nov 14 21:23:11 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d, portal: 172.16.0.220,3260] successful.
Nov 14 21:23:11 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a6b5be-dc15-43a2-9a71-4c223a937197]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f4fde9-3d48-420e-84fa-f29fd08ca282]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d (non-flash)
Nov 14 21:23:11 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d (non-flash)
Nov 14 21:23:11 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.231s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c391d87d-6fac-444f-9e0c-a63fcc1d7b78]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:23:11 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVgLcOTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:23:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:23:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23365393939333261', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:23:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365393939333261', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:23:12 user nova-compute[76442]: DEBUG nova.objects.instance [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:23:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 21:23:12 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:23:12 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:23:12 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:23:12 user nova-compute[76442]:   <serial>cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d</serial>
Nov 14 21:23:12 user nova-compute[76442]: </disk>
Nov 14 21:23:12 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 21:23:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:23:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:23:12 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No VIF found with MAC fa:16:3e:56:b5:41, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:23:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-91aecc06-163c-4fa0-bd98-c85f1b6f6a20 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.318s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:23:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:23:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:23:20 user nova-compute[76442]: INFO nova.compute.manager [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Detaching volume cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d
Nov 14 21:23:20 user nova-compute[76442]: INFO nova.virt.block_device [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attempting to driver detach volume cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d from mountpoint /dev/vdb
Nov 14 21:23:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Attempting to detach device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 21:23:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:23:20 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:23:20 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:23:20 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:23:20 user nova-compute[76442]:   <serial>cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d</serial>
Nov 14 21:23:20 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:23:20 user nova-compute[76442]: </disk>
Nov 14 21:23:20 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:23:20 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully detached device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the persistent domain config.
Nov 14 21:23:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 21:23:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:23:20 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:23:20 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:23:20 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:23:20 user nova-compute[76442]:   <serial>cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d</serial>
Nov 14 21:23:20 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:23:20 user nova-compute[76442]: </disk>
Nov 14 21:23:20 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:23:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 21:23:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:23:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:23:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:23:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:23:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:37 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:38 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:40 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b26074c-28bb-4c90-a225-01027f0831bc is timed out.
Nov 14 21:23:40 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully detached device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the live domain config.
Nov 14 21:23:40 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVgLcOTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:23:40 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcac241-1ba5-4eb4-8d81-48ba7ca8f226]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:23:40 user nova-compute[76442]: No targets found.
Nov 14 21:23:40 user nova-compute[76442]: iSNS:
Nov 14 21:23:40 user nova-compute[76442]: No targets found.
Nov 14 21:23:40 user nova-compute[76442]: STATIC:
Nov 14 21:23:40 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d
Nov 14 21:23:40 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:23:40 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:23:40 user nova-compute[76442]: FIRMWARE:
Nov 14 21:23:40 user nova-compute[76442]: No targets found.
Nov 14 21:23:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:23:40 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:23:40 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc41778-450d-4718-8fb5-0eb4ff29681d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd96639-313f-4416-990c-4dcd8ba2d4a6]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d (non-flash)
Nov 14 21:23:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d (non-flash)
Nov 14 21:23:40 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07143f72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cfd145-5005-4e21-be24-6cc47827d9a4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5ec337-0bd9-47a6-8617-e8987e88ca51]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5bd98d-3a72-476d-9675-1b88f33e8df7]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:23:40 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1a3870-865c-46fa-8615-7bb75baf9eb9]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c058c7a-7c34-43f3-88c9-ed3c3ab3e83e]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f812c88-ea69-47ce-bc39-45cf22bb7a11]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d, portal: 172.16.0.220,3260]
Nov 14 21:23:41 user nova-compute[76442]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d, portal: 172.16.0.220,3260] successful.
Nov 14 21:23:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd0a8ef-4395-42ec-b7e5-aa02edd0c89d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc49148-0b3b-4f4d-85c3-b127ebfcadbf]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== disconnect_volume: return (274ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG nova.objects.instance [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:23:41 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b0f79497-17cc-49ef-8297-cd11f87e2f4f tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.558s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:23:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:23:47 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:23:48 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:49 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:23:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:23:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:23:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:23:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:23:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:23:51 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:23:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:23:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:23:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:23:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:23:52 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:23:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:23:52 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:23:53 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:23:53 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:23:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9060MB free_disk=25.031482696533203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:23:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:23:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:23:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 6b26074c-28bb-4c90-a225-01027f0831bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:23:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:23:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:23:53 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:23:53 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:23:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:23:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:23:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:23:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:23:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:23:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:23:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:23:57 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:24:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:24:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:24:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:24:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:24:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:24:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:24:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:24:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG nova.objects.instance [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:24:12 user nova-compute[76442]: INFO nova.compute.manager [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attaching volume 29781457-5ce0-45d3-8de6-60d7de263b5c to /dev/vdb
Nov 14 21:24:12 user nova-compute[76442]: DEBUG os_brick.utils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1079d0ff-1d6e-405b-8ebf-b1a2e7bb20b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa36cb-5a0b-4740-a296-5481f1d9e358]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91c6d20-cff8-4a33-9fed-021292e932ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99f73f7-9626-448e-bdd8-ee9e4bf21522]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:24:12 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:24:12 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8e69be-95bb-4b21-b560-88176f5c181b]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG os_brick.utils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:24:12 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating existing volume attachment record: a5e04efc-d91b-43c0-83bc-26c8a7fc70db {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:24:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:24:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYzWCOSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:24:16 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:24:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:24:16 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:24:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:24:16 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0727d789-007b-42d0-8e3d-62c8bef5075a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:24:16 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebdda43-d1b8-4a42-aa25-fd7b562fd738]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c] added
Nov 14 21:24:16 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[f235b59b-7945-4bbe-af70-98488cc08404]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:16 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac90c7b-39bf-455f-8cfa-4dee84382fcb]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYzWCOSp {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYzWCOSp" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[5807d213-459f-4faf-ab21-46a149b4f451]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LYzWCOSp'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccad10ad-e22f-41c7-abba-ec770a963cb6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d6e462-67bc-4876-a56b-5c4109bfcd39]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:24:17 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:24:17 user nova-compute[76442]:  {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:24:17 user nova-compute[76442]: WARNING os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 21:24:17 user nova-compute[76442]: 
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eccb13-d0ae-4a3a-84a2-7bb08362f382]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c, portal: 172.16.0.220,3260]
Nov 14 21:24:17 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c, portal: 172.16.0.220,3260] successful.
Nov 14 21:24:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e767d4f9-02b9-4177-a69f-bcb39e1378f6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a371a4-9102-4e5a-85a2-ff1ca6d9ab85]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c (non-flash)
Nov 14 21:24:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c (non-flash)
Nov 14 21:24:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf68103-f86d-4ab1-9776-5750bf57d9ef]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:24:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYzWCOSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:24:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:24:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26366396266356335', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:24:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366396266356335', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:24:18 user nova-compute[76442]: DEBUG nova.objects.instance [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:24:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 21:24:18 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:24:18 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:24:18 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:24:18 user nova-compute[76442]:   <serial>29781457-5ce0-45d3-8de6-60d7de263b5c</serial>
Nov 14 21:24:18 user nova-compute[76442]: </disk>
Nov 14 21:24:18 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 21:24:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:24:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:24:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No VIF found with MAC fa:16:3e:56:b5:41, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:24:18 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-90099be7-3b55-4867-a8c3-f587ed183664 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.141s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:24:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:24:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:24:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:24:20 user nova-compute[76442]: INFO nova.compute.manager [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Detaching volume 29781457-5ce0-45d3-8de6-60d7de263b5c
Nov 14 21:24:20 user nova-compute[76442]: INFO nova.virt.block_device [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attempting to driver detach volume 29781457-5ce0-45d3-8de6-60d7de263b5c from mountpoint /dev/vdb
Nov 14 21:24:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Attempting to detach device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 21:24:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:24:20 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:24:20 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:24:20 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:24:20 user nova-compute[76442]:   <serial>29781457-5ce0-45d3-8de6-60d7de263b5c</serial>
Nov 14 21:24:20 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:24:20 user nova-compute[76442]: </disk>
Nov 14 21:24:20 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:24:20 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully detached device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the persistent domain config.
Nov 14 21:24:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 21:24:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:24:20 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:24:20 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:24:20 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:24:20 user nova-compute[76442]:   <serial>29781457-5ce0-45d3-8de6-60d7de263b5c</serial>
Nov 14 21:24:20 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:24:20 user nova-compute[76442]: </disk>
Nov 14 21:24:20 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:24:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 21:24:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:24:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:24:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:24:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:24:39 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:24:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:24:41 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b26074c-28bb-4c90-a225-01027f0831bc is timed out.
Nov 14 21:24:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully detached device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the live domain config.
Nov 14 21:24:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYzWCOSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:24:41 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce0467c-5199-41f0-b208-83e559e13c9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:24:41 user nova-compute[76442]: No targets found.
Nov 14 21:24:41 user nova-compute[76442]: iSNS:
Nov 14 21:24:41 user nova-compute[76442]: No targets found.
Nov 14 21:24:41 user nova-compute[76442]: STATIC:
Nov 14 21:24:41 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c
Nov 14 21:24:41 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:24:41 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:24:41 user nova-compute[76442]: FIRMWARE:
Nov 14 21:24:41 user nova-compute[76442]: No targets found.
Nov 14 21:24:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:24:41 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:24:41 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[553a2803-9c5a-4cc7-85bb-8c2576582831]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2291f3-64db-48ee-950a-2d9e17e41c77]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c (non-flash)
Nov 14 21:24:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c (non-flash)
Nov 14 21:24:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06e84895a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[829569f3-6359-4882-af58-3ead8f505ee1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f2ce53-fd53-4b0c-97ab-dcbfb29c73fe]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a5a60e-5491-458a-ae7d-d08df29f953a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db2b10e-3f79-4f75-b50f-aa82c6e987d2]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a255a499-56f6-4164-9e04-5eed0b47bc59]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c61ad4f-b871-4b89-908b-1237fb645d04]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c, portal: 172.16.0.220,3260]
Nov 14 21:24:41 user nova-compute[76442]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c, portal: 172.16.0.220,3260] successful.
Nov 14 21:24:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29781457-5ce0-45d3-8de6-60d7de263b5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f05ec3d-f175-40b9-b74c-9f4f0ef913c9]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== disconnect_volume: return (267ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:24:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:24:42 user nova-compute[76442]: DEBUG nova.objects.instance [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:24:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-9a30a0be-ded6-48f3-99f2-3ac038e3c0ac tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.585s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:24:42 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:24:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:24:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:24:47 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:24:47 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:24:49 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:24:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:24:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:24:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:24:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:24:52 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:24:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:24:52 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:24:52 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:24:52 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:24:53 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:24:53 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:24:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=25.030540466308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:24:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:24:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 6b26074c-28bb-4c90-a225-01027f0831bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:24:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:24:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:24:54 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:24:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:24:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:24:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:24:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:24:59 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:25:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:25:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:25:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:25:12 user nova-compute[76442]: DEBUG nova.objects.instance [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:25:12 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:25:13 user nova-compute[76442]: INFO nova.compute.manager [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attaching volume 9c561b27-08fe-4080-9837-c6441c20424a to /dev/vdb
Nov 14 21:25:13 user nova-compute[76442]: DEBUG os_brick.utils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[491053f2-be87-4c7e-8c5a-03bdaab3bdb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3128fb2c-7d5e-4ec0-bbc1-b69568999a7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[25507f8e-cfc5-4705-9368-fba5919719f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e25515-f678-47b4-b438-2b91fe748e0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:25:13 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:25:13 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[1321d3ce-6d68-4a48-af13-765338c03ad3]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG os_brick.utils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:25:13 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating existing volume attachment record: 31de2066-a349-44f2-8bbb-a6051bf70d36 {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:25:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCkIFzjr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:25:17 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:25:17 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:25:17 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[584997db-6874-4462-858c-16dbac782324]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:25:17 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73dda30-1c99-4548-83c2-b2e3fe5ffafb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a] added
Nov 14 21:25:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[860523f5-9c47-411e-9778-3e450a827ae3]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f0fd03-4ded-4c3a-bcc9-dcd8ae7350b8]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCkIFzjr {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCkIFzjr" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3068d98-09ea-4fc6-9c86-dcb6c8f87762]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GCkIFzjr'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1390228-8afa-4d70-be10-19a2db641f34]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[48172eac-4889-44b6-a2ee-a553e17e6544]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:25:17 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:25:17 user nova-compute[76442]:  {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:25:17 user nova-compute[76442]: WARNING os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 21:25:17 user nova-compute[76442]: 
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --login" returned: 0 in 0.040s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f0263-af21-40e9-971f-1782b99c3cd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a, portal: 172.16.0.220,3260]
Nov 14 21:25:17 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a, portal: 172.16.0.220,3260] successful.
Nov 14 21:25:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb0de28-ba21-4732-b4da-ade15497e598]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f994e86-d1ee-4151-8fee-f13295fccd86]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a (non-flash)
Nov 14 21:25:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a (non-flash)
Nov 14 21:25:17 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.228s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac58af9-57a6-4fd4-b220-41f59a0c9ccc]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:25:17 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCkIFzjr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:25:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:25:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '26535383363633537', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:25:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535383363633537', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:25:18 user nova-compute[76442]: DEBUG nova.objects.instance [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:25:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 21:25:18 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:25:18 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:25:18 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:25:18 user nova-compute[76442]:   <serial>9c561b27-08fe-4080-9837-c6441c20424a</serial>
Nov 14 21:25:18 user nova-compute[76442]: </disk>
Nov 14 21:25:18 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 21:25:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:25:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:25:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No VIF found with MAC fa:16:3e:56:b5:41, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:25:19 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-b41bce47-15ef-4dd4-946a-034905b07597 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.118s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:25:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:25:21 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:25:21 user nova-compute[76442]: INFO nova.compute.manager [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Detaching volume 9c561b27-08fe-4080-9837-c6441c20424a
Nov 14 21:25:21 user nova-compute[76442]: INFO nova.virt.block_device [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attempting to driver detach volume 9c561b27-08fe-4080-9837-c6441c20424a from mountpoint /dev/vdb
Nov 14 21:25:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Attempting to detach device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 21:25:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:25:21 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:25:21 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:25:21 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:25:21 user nova-compute[76442]:   <serial>9c561b27-08fe-4080-9837-c6441c20424a</serial>
Nov 14 21:25:21 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:25:21 user nova-compute[76442]: </disk>
Nov 14 21:25:21 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:25:21 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully detached device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the persistent domain config.
Nov 14 21:25:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 21:25:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:25:21 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:25:21 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:25:21 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:25:21 user nova-compute[76442]:   <serial>9c561b27-08fe-4080-9837-c6441c20424a</serial>
Nov 14 21:25:21 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:25:21 user nova-compute[76442]: </disk>
Nov 14 21:25:21 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:25:21 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 21:25:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:25:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:41 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b26074c-28bb-4c90-a225-01027f0831bc is timed out.
Nov 14 21:25:41 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully detached device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the live domain config.
Nov 14 21:25:41 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCkIFzjr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:25:41 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ad9ade-9c5e-4996-8222-76d817c992a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:25:41 user nova-compute[76442]: No targets found.
Nov 14 21:25:41 user nova-compute[76442]: iSNS:
Nov 14 21:25:41 user nova-compute[76442]: No targets found.
Nov 14 21:25:41 user nova-compute[76442]: STATIC:
Nov 14 21:25:41 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a
Nov 14 21:25:41 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:25:41 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:25:41 user nova-compute[76442]: FIRMWARE:
Nov 14 21:25:41 user nova-compute[76442]: No targets found.
Nov 14 21:25:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:25:41 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:25:41 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe06bbf-708d-4dd2-926b-80fa5fdd84d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9db33d-b9f2-49f6-ab7a-58fb7f60d298]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a (non-flash)
Nov 14 21:25:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a (non-flash)
Nov 14 21:25:41 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4c94550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[492185b9-e4c6-4af5-b305-5358ff3e3edc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b81f49-015a-4ed7-bee6-77764fcdfdb8]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b31b624-6cbb-42a9-8c0e-259eee3d4e5a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[8322278d-3ada-43ca-bf17-5eef8335022f]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc22b786-4199-4301-880c-b4fee41172ce]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:41 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c67f7f-facf-4e62-b0a0-6212e2e4fdc1]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a, portal: 172.16.0.220,3260]
Nov 14 21:25:42 user nova-compute[76442]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a, portal: 172.16.0.220,3260] successful.
Nov 14 21:25:42 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c561b27-08fe-4080-9837-c6441c20424a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd44cea-d734-49f2-9dd2-b69c1c83c881]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== disconnect_volume: return (281ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:25:42 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5a08067d-fed8-40de-85a2-957b9f0bb68c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:25:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:25:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:48 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:48 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:25:49 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:52 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:25:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:25:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:25:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:25:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:25:54 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:25:54 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:25:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9060MB free_disk=25.029544830322266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 6b26074c-28bb-4c90-a225-01027f0831bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:25:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:25:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:25:56 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:25:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:25:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:25:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:26:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:26:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:13 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:26:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:26:13 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:26:13 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:26:14 user nova-compute[76442]: INFO nova.compute.manager [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attaching volume dc235a33-805b-433f-88bc-2c20c39f23d7 to /dev/vdb
Nov 14 21:26:14 user nova-compute[76442]: DEBUG os_brick.utils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8171e05-957d-4098-8b19-b87318feae16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:80ad6e8a451\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ec853e-96a8-4c9e-a4b2-1b0f17cbaa2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13fa519-bebf-4517-87d5-d5761ac39c10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[748dafe4-1f05-4779-8066-9df2fd3fb9fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Running cmd (subprocess): nvme version {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] 'nvme version' failed. Not Retrying. {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] nvme not present on system {{(pid=76442) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 21:26:14 user nova-compute[76442]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 21:26:14 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b342ea-953f-494f-87ab-deeba2a70b3f]: (4, '') {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76442) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.lightos [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] LIGHTOS: no hostnqn found. {{(pid=76442) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG os_brick.utils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:80ad6e8a451', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:26:14 user nova-compute[76442]: DEBUG nova.virt.block_device [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating existing volume attachment record: 7d91f2a1-a0af-43b1-b961-b1338f18866f {{(pid=76442) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 21:26:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Calling os-brick to attach iSCSI Volume {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGmpuDnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:26:18 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:26:18 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:26:18 user nova-compute[76442]: INFO os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce9420e-a01b-4b96-bcd0-0b85a6ed49ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 21:26:18 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[889e65c7-8b96-4c76-9e6b-4c329adb6946]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7] added\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7] added
Nov 14 21:26:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3c79a5-9d05-411e-943d-6f83929f8bc6]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0500bc-2041-4f84-94a6-c10887e5a691]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGmpuDnO {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGmpuDnO" returned: 0 in 0.020s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[a349141f-643f-4f7d-b314-770f4b738276]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gGmpuDnO'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[91053184-e6af-4571-9d10-7f017de6e074]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3fc5b1-a2db-4666-a44b-babed3759196]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:26:18 user nova-compute[76442]:  {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 21:26:18 user nova-compute[76442]:  {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:26:18 user nova-compute[76442]: WARNING os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 21:26:18 user nova-compute[76442]: 
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --login {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[af05dc6d-29a7-41ac-aac5-b0bb2f7dc642]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7, portal: 172.16.0.220,3260]
Nov 14 21:26:18 user nova-compute[76442]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7, portal: 172.16.0.220,3260] successful.
Nov 14 21:26:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f094bb-6f26-4d53-90bf-a38133a392dc]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[4393cf72-01b6-478f-add7-780db82a7fae]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 (non-flash)
Nov 14 21:26:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 (non-flash)
Nov 14 21:26:18 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Connected to 172.16.0.220:3260 {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=76442) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76442) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[986632d8-b510-4646-aa0e-786faf403765]: (4, ('- - 0', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76442) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 21:26:18 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGmpuDnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76442) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 21:26:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:26:19 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23238346562313831', 'path': '/dev/sdb'} {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:26:19 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238346562313831', 'path': '/dev/sdb'} {{(pid=76442) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 21:26:19 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:26:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 21:26:20 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:26:20 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:26:20 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:26:20 user nova-compute[76442]:   <serial>dc235a33-805b-433f-88bc-2c20c39f23d7</serial>
Nov 14 21:26:20 user nova-compute[76442]: </disk>
Nov 14 21:26:20 user nova-compute[76442]:  {{(pid=76442) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 21:26:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No BDM found with device name vda, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:26:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76442) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 21:26:20 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] No VIF found with MAC fa:16:3e:56:b5:41, not building metadata {{(pid=76442) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 21:26:20 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7401fac1-a688-450d-ab8a-535eb65d7ade tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.175s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:26:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:26:22 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:26:22 user nova-compute[76442]: INFO nova.compute.manager [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Detaching volume dc235a33-805b-433f-88bc-2c20c39f23d7
Nov 14 21:26:22 user nova-compute[76442]: INFO nova.virt.block_device [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Attempting to driver detach volume dc235a33-805b-433f-88bc-2c20c39f23d7 from mountpoint /dev/vdb
Nov 14 21:26:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Attempting to detach device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the persistent domain config. {{(pid=76442) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 21:26:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:26:22 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:26:22 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:26:22 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:26:22 user nova-compute[76442]:   <serial>dc235a33-805b-433f-88bc-2c20c39f23d7</serial>
Nov 14 21:26:22 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:26:22 user nova-compute[76442]: </disk>
Nov 14 21:26:22 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:26:22 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully detached device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the persistent domain config.
Nov 14 21:26:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the live domain config. {{(pid=76442) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 21:26:22 user nova-compute[76442]: DEBUG nova.virt.libvirt.guest [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 21:26:22 user nova-compute[76442]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 21:26:22 user nova-compute[76442]:   <source dev="/dev/sdb"/>
Nov 14 21:26:22 user nova-compute[76442]:   <target dev="vdb" bus="virtio"/>
Nov 14 21:26:22 user nova-compute[76442]:   <serial>dc235a33-805b-433f-88bc-2c20c39f23d7</serial>
Nov 14 21:26:22 user nova-compute[76442]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 21:26:22 user nova-compute[76442]: </disk>
Nov 14 21:26:22 user nova-compute[76442]:  {{(pid=76442) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 21:26:23 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:23 user nova-compute[76442]: DEBUG nova.virt.libvirt.driver [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 21:26:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:26:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:30 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:35 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:26:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:40 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:43 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b26074c-28bb-4c90-a225-01027f0831bc is timed out.
Nov 14 21:26:43 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully detached device vdb from instance 6b26074c-28bb-4c90-a225-01027f0831bc from the live domain config.
Nov 14 21:26:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] calling os-brick to detach iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f06e84d0250>, {'target_iqn': 'iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGmpuDnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 21:26:43 user nova-compute[76442]: WARNING os_brick.initiator.connectors.base [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[762c5f3d-6977-4d0c-8145-502a5b3d5f94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 21:26:43 user nova-compute[76442]: No targets found.
Nov 14 21:26:43 user nova-compute[76442]: iSNS:
Nov 14 21:26:43 user nova-compute[76442]: No targets found.
Nov 14 21:26:43 user nova-compute[76442]: STATIC:
Nov 14 21:26:43 user nova-compute[76442]: Target: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7
Nov 14 21:26:43 user nova-compute[76442]:         Portal: 172.16.0.220:3260,-1
Nov 14 21:26:43 user nova-compute[76442]:                 Iface Name: default
Nov 14 21:26:43 user nova-compute[76442]: FIRMWARE:
Nov 14 21:26:43 user nova-compute[76442]: No targets found.
Nov 14 21:26:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 21:26:43 user nova-compute[76442]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 21:26:43 user nova-compute[76442]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76442) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7', 0)] {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443acd7-6c60-4a5d-8985-cc6aa9f24b65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a21b58-8eaa-49e7-9f79-f42b594f5fea]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 (non-flash)\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 (non-flash)
Nov 14 21:26:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 (non-flash)
Nov 14 21:26:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f06c4fee7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7'): ({'sdb'}, set())}) {{(pid=76442) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Removing single pathed devices sdb {{(pid=76442) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb41cfdc-23fb-4786-bce3-8390fb776108]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cd00e1-bf74-49c6-a631-b0aeb4413522]: (4, ('ok\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Flushing IO for device /dev/sdb {{(pid=76442) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[0387393c-07a7-42e1-88a5-a142a91c816a]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76442) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b4e45d-fb83-4fe5-94b0-06090bbfc7c6]: (4, ('1', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.linuxscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] SCSI volumes sdb have been removed. {{(pid=76442) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7')] {{(pid=76442) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a382fa9-a867-41b5-883e-606cc48a0962]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --logout {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c4a4f5-1aee-43bd-ad18-b6f31817896f]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7, portal: 172.16.0.220,3260]
Nov 14 21:26:43 user nova-compute[76442]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7, portal: 172.16.0.220,3260] successful.
Nov 14 21:26:43 user nova-compute[76442]:  stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op delete {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc235a33-805b-433f-88bc-2c20c39f23d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87657) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2b2bfb-d16c-41f5-912c-07492fe353ad]: (4, ('', '')) {{(pid=87657) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76442) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.base [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG os_brick.initiator.connectors.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] <== disconnect_volume: return (294ms) None {{(pid=76442) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 21:26:43 user nova-compute[76442]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Disconnected iSCSI Volume {{(pid=76442) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 21:26:44 user nova-compute[76442]: DEBUG nova.objects.instance [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'flavor' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:26:44 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-d726929a-c5f1-4502-99f8-580632bc0e0c tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.558s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:26:45 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:26:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:45 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:48 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:49 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:49 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 21:26:49 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] There are 0 instances to clean {{(pid=76442) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 21:26:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:26:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:26:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:26:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:50 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 21:26:53 user nova-compute[76442]: DEBUG oslo_concurrency.processutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76442) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 21:26:54 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:26:54 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=25.02080535888672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Instance 6b26074c-28bb-4c90-a225-01027f0831bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76442) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing inventories for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating ProviderTree inventory for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Updating inventory in ProviderTree for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing aggregate associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, aggregates: None {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Refreshing trait associations for resource provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f, traits: HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=76442) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:26:54 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:26:55 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:26:56 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:26:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:26:56 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:26:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 21:26:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquired lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 21:26:56 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Forcefully refreshing network info cache for instance {{(pid=76442) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 21:26:56 user nova-compute[76442]: DEBUG nova.objects.instance [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lazy-loading 'info_cache' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:26:57 user nova-compute[76442]: DEBUG nova.network.neutron [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [{"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:26:57 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Releasing lock "refresh_cache-6b26074c-28bb-4c90-a225-01027f0831bc" {{(pid=76442) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 21:26:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updated the network info_cache for instance {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 21:26:58 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:00 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:05 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:27:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:27:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:27:10 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:15 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:27:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:27:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:27:20 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:22 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:22 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Cleaning up deleted instances with incomplete migration  {{(pid=76442) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:27:25 user nova-compute[76442]: INFO nova.compute.manager [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Terminating instance
Nov 14 21:27:25 user nova-compute[76442]: DEBUG nova.compute.manager [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Start destroying the instance on the hypervisor. {{(pid=76442) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:25 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-35c2276d-2c38-4546-b5f7-901ce3032d9e req-82d5d1d8-f634-4676-a677-89a2bcd0f74f service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received event network-vif-unplugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-35c2276d-2c38-4546-b5f7-901ce3032d9e req-82d5d1d8-f634-4676-a677-89a2bcd0f74f service nova] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-35c2276d-2c38-4546-b5f7-901ce3032d9e req-82d5d1d8-f634-4676-a677-89a2bcd0f74f service nova] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-35c2276d-2c38-4546-b5f7-901ce3032d9e req-82d5d1d8-f634-4676-a677-89a2bcd0f74f service nova] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-35c2276d-2c38-4546-b5f7-901ce3032d9e req-82d5d1d8-f634-4676-a677-89a2bcd0f74f service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] No waiting events found dispatching network-vif-unplugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG nova.compute.manager [req-35c2276d-2c38-4546-b5f7-901ce3032d9e req-82d5d1d8-f634-4676-a677-89a2bcd0f74f service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received event network-vif-unplugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 for instance with task_state deleting. {{(pid=76442) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [-] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Instance destroyed successfully.
Nov 14 21:27:26 user nova-compute[76442]: DEBUG nova.objects.instance [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lazy-loading 'resources' on Instance uuid 6b26074c-28bb-4c90-a225-01027f0831bc {{(pid=76442) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG nova.virt.libvirt.vif [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T21:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-714984422',display_name='tempest-SnapshotDataIntegrityTests-server-714984422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-714984422',id=53,image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYNb1m1OfMGb2MzJztYli5sI6YqXObmj+e5zZE+tDXx/HZxU3oIvcnai15E635MaxaBeFJPPTjfIkJj0Gllv9I7b8ycRHu430bZrI5SqBDytgkbh7cDX34wphuagLAslw==',key_name='tempest-keypair-2050069723',keypairs=<?>,launch_index=0,launched_at=2023-11-14T21:21:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a919404873de4759b5a59388e5578338',ramdisk_id='',reservation_id='r-akfiyspl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c456f24a-ee5e-4551-88d7-a8348db880df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1262047182',owner_user_name='tempest-SnapshotDataIntegrityTests-1262047182-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T21:21:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc7ffc8fcab14f7a95ef9204a33597d3',uuid=6b26074c-28bb-4c90-a225-01027f0831bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Converting VIF {"id": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "address": "fa:16:3e:56:b5:41", "network": {"id": "b7b97d43-8bf3-45a7-b12c-cd89a08ed767", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-836229661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a919404873de4759b5a59388e5578338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0617e22-dc", "ovs_interfaceid": "d0617e22-dc6d-4fa1-bd04-c4bcdb670660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG nova.network.os_vif_util [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:b5:41,bridge_name='br-int',has_traffic_filtering=True,id=d0617e22-dc6d-4fa1-bd04-c4bcdb670660,network=Network(b7b97d43-8bf3-45a7-b12c-cd89a08ed767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0617e22-dc') {{(pid=76442) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG os_vif [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:b5:41,bridge_name='br-int',has_traffic_filtering=True,id=d0617e22-dc6d-4fa1-bd04-c4bcdb670660,network=Network(b7b97d43-8bf3-45a7-b12c-cd89a08ed767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0617e22-dc') {{(pid=76442) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0617e22-dc, bridge=br-int, if_exists=True) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53cb70d0-604b-4e0a-b480-dd1dcc94d191) {{(pid=76442) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:26 user nova-compute[76442]: INFO os_vif [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:b5:41,bridge_name='br-int',has_traffic_filtering=True,id=d0617e22-dc6d-4fa1-bd04-c4bcdb670660,network=Network(b7b97d43-8bf3-45a7-b12c-cd89a08ed767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0617e22-dc')
Nov 14 21:27:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Deleting instance files /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc_del
Nov 14 21:27:26 user nova-compute[76442]: INFO nova.virt.libvirt.driver [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Deletion of /opt/stack/data/nova/instances/6b26074c-28bb-4c90-a225-01027f0831bc_del complete
Nov 14 21:27:26 user nova-compute[76442]: INFO nova.compute.manager [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 21:27:26 user nova-compute[76442]: DEBUG oslo.service.loopingcall [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76442) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG nova.compute.manager [-] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Deallocating network for instance {{(pid=76442) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 21:27:26 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] deallocate_for_instance() {{(pid=76442) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 21:27:27 user nova-compute[76442]: DEBUG nova.network.neutron [-] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Updating instance_info_cache with network_info: [] {{(pid=76442) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 21:27:27 user nova-compute[76442]: INFO nova.compute.manager [-] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Took 0.68 seconds to deallocate network for instance.
Nov 14 21:27:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:27:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:27:27 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:27:27 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:27:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:27:27 user nova-compute[76442]: INFO nova.scheduler.client.report [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Deleted allocations for instance 6b26074c-28bb-4c90-a225-01027f0831bc
Nov 14 21:27:27 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-7b6e750d-3269-47cc-870e-1feb0ced7448 tempest-SnapshotDataIntegrityTests-1262047182 tempest-SnapshotDataIntegrityTests-1262047182-project-member] Lock "6b26074c-28bb-4c90-a225-01027f0831bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:27:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-583bc759-7459-4892-9acf-83a011cdb3c1 req-687a0d28-d37d-4161-a7fc-5cf14d6580d5 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received event network-vif-plugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:27:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-583bc759-7459-4892-9acf-83a011cdb3c1 req-687a0d28-d37d-4161-a7fc-5cf14d6580d5 service nova] Acquiring lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:27:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-583bc759-7459-4892-9acf-83a011cdb3c1 req-687a0d28-d37d-4161-a7fc-5cf14d6580d5 service nova] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:27:28 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [req-583bc759-7459-4892-9acf-83a011cdb3c1 req-687a0d28-d37d-4161-a7fc-5cf14d6580d5 service nova] Lock "6b26074c-28bb-4c90-a225-01027f0831bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:27:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-583bc759-7459-4892-9acf-83a011cdb3c1 req-687a0d28-d37d-4161-a7fc-5cf14d6580d5 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] No waiting events found dispatching network-vif-plugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 21:27:28 user nova-compute[76442]: WARNING nova.compute.manager [req-583bc759-7459-4892-9acf-83a011cdb3c1 req-687a0d28-d37d-4161-a7fc-5cf14d6580d5 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received unexpected event network-vif-plugged-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 for instance with vm_state deleted and task_state None.
Nov 14 21:27:28 user nova-compute[76442]: DEBUG nova.compute.manager [req-583bc759-7459-4892-9acf-83a011cdb3c1 req-687a0d28-d37d-4161-a7fc-5cf14d6580d5 service nova] [instance: 6b26074c-28bb-4c90-a225-01027f0831bc] Received event network-vif-deleted-d0617e22-dc6d-4fa1-bd04-c4bcdb670660 {{(pid=76442) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 21:27:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76442) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 21:27:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:27:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76442) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 21:27:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:45 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:46 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:27:50 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:50 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76442) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 21:27:51 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:51 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:53 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager.update_available_resource {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Auditing locally available compute resources for user (node: user) {{(pid=76442) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 21:27:55 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:27:55 user nova-compute[76442]: WARNING nova.virt.libvirt.driver [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 21:27:55 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Hypervisor/Node resource view: name=user free_ram=9189MB free_disk=25.04794692993164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=76442) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76442) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG nova.compute.provider_tree [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed in ProviderTree for provider: 8fc56580-8aa8-4b89-aaa5-43465a1eed3f {{(pid=76442) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 21:27:55 user nova-compute[76442]: DEBUG nova.scheduler.client.report [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Inventory has not changed for provider 8fc56580-8aa8-4b89-aaa5-43465a1eed3f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76442) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 21:27:56 user nova-compute[76442]: DEBUG nova.compute.resource_tracker [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Compute_service record updated for user:user {{(pid=76442) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 21:27:56 user nova-compute[76442]: DEBUG oslo_concurrency.lockutils [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=76442) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 21:27:56 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:27:57 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:27:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Starting heal instance info cache {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 21:27:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Rebuilding the list of instances to heal {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 21:27:57 user nova-compute[76442]: DEBUG nova.compute.manager [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Didn't find any instances for network info cache update. {{(pid=76442) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 21:28:00 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:28:01 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:06 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:28:11 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:16 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:19 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:21 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:22 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:26 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:31 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:36 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 21:28:41 user nova-compute[76442]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=76442) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 21:28:43 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 21:28:45 user nova-compute[76442]: DEBUG oslo_service.periodic_task [None req-5ab9e241-5dea-4c57-9d2e-4bd904cf43db None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76442) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}